-- Logs begin at Wed 2022-05-11 06:56:21 UTC, end at Wed 2022-05-11 08:00:42 UTC. -- May 11 07:29:33.988845 dv-cinder-836996-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 11 07:29:33.998159 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 11 07:29:34.000143 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 07:29:33 2022] *** May 11 07:29:34.000143 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 07:29:34.000143 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 07:29:34.000143 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: nodename: dv-cinder-836996-20-iscsi May 11 07:29:34.000143 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: machine: x86_64 May 11 07:29:34.000143 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: clock source: unix May 11 07:29:34.000143 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: pcre jit disabled May 11 07:29:34.000143 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: detected number of CPU cores: 4 May 11 07:29:34.000143 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: current working directory: / May 11 07:29:34.000143 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: detected binary path: /usr/bin/uwsgi-core May 11 07:29:34.000814 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: your processes number limit is 47680 May 11 07:29:34.000814 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: your memory page size is 4096 bytes May 11 07:29:34.000814 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: detected max file descriptor number: 2048 May 11 07:29:34.000814 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: lock engine: pthread robust mutexes May 11 07:29:34.000814 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: thunder lock: enabled May 11 07:29:34.000814 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 11 07:29:34.000814 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 07:29:34.044832 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: Python main interpreter initialized at 0x55df103739c0 May 11 07:29:34.044832 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: python threads support enabled May 11 07:29:34.044832 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: your server socket listen backlog is limited to 100 connections May 11 07:29:34.044832 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: your mercy for graceful operations on workers is 90 seconds May 11 07:29:34.045127 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: mapped 403077 bytes (393 KB) for 2 cores May 11 07:29:34.045213 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: *** Operational MODE: preforking *** May 11 07:29:34.045473 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: *** uWSGI is running in multiple interpreter mode *** May 11 07:29:34.045473 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: spawned uWSGI master process (pid: 102826) May 11 07:29:34.045669 dv-cinder-836996-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 11 07:29:34.048474 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: spawned uWSGI worker 1 (pid: 102827, cores: 1) May 11 07:29:34.048474 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: spawned uWSGI worker 2 (pid: 102828, cores: 1) May 11 07:29:34.048474 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 07:29:35.239659 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 07:29:35.243021 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 07:29:35.972330 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 07:29:35.972330 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: from cryptography.utils import int_from_bytes May 11 07:29:35.972653 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 07:29:35.972653 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: from cryptography.utils import int_from_bytes May 11 07:29:35.974400 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 07:29:35.974400 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: from cryptography.utils import int_from_bytes May 11 07:29:35.974727 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 07:29:35.974727 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: from cryptography.utils import int_from_bytes May 11 07:29:38.575973 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 07:29:38.576495 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 07:29:38.576751 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 07:29:38.577116 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 07:29:38.577373 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 07:29:38.577795 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.577899 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 07:29:38.578252 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 07:29:38.578343 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.578423 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.578618 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 07:29:38.578745 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.578986 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 07:29:38.579080 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.579244 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 07:29:38.579379 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.579631 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.579719 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.579961 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.580054 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.580287 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.580382 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.580579 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.580672 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.580898 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.580985 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.581230 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-20-iscsi {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.581362 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.581558 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.581665 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.581876 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.581974 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.582187 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.582275 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.582467 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.582554 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.582787 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.582880 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.583114 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.583206 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-20-iscsi {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.583429 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.583522 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.583737 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.583932 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.585303 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.585303 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.585686 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.585686 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.586051 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.586262 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.586442 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.586442 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.586776 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.586776 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.587132 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.587375 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.587564 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.587757 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.587950 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.588111 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.588335 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.588487 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.588716 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.588873 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.589090 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.589280 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-20-iscsi {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.589432 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.589677 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.589857 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.590019 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.590214 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.590375 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.590509 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.590667 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.590808 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.590972 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.591101 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-20-iscsi {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.591232 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.591359 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.591513 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.591693 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.591821 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.591959 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.592218 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.592361 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.592496 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.592635 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.592762 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.592894 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.593053 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.593193 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.593331 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.593458 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.593607 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.593735 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.593873 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.594000 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.594132 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.594259 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.594385 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.594519 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.594652 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.594780 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.594913 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.595039 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.595172 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.595307 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.595435 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.595573 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.595756 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.595884 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.596009 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.596146 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.596274 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.596404 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.596537 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.596676 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.596816 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.596945 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.597076 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.597203 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.597336 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.597463 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.597626 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.597756 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.597883 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.598008 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.598140 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.598275 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.598403 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.598529 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.598656 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.598788 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.598915 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.599050 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.599176 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.599301 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.599426 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.599550 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.599683 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.599821 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.599947 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.600079 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.600213 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.600349 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.600484 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.600618 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.600750 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.600876 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.601013 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.601139 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.601278 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.601413 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.601592 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.601721 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.601866 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.601994 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.602144 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.602399 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.602530 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.602655 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.602781 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.602914 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.603049 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.603175 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.603301 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.603426 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.603551 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.603685 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.603812 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.603937 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.604062 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.604187 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.604312 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.604449 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.604576 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.604701 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.604825 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.604951 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.605076 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.605214 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.605340 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.605476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.605634 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.605761 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.605886 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.606024 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.606164 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.606290 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.606416 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.606540 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.606744 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.606873 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.607000 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.607132 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.607258 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.607383 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.607525 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.607652 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.607778 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.607902 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.608029 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.608161 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.608295 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.608422 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.608554 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.608680 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.608805 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.608937 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.609109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.609241 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.609431 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.609592 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.609778 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.609920 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.610089 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.610221 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.610397 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.610534 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.610706 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.610845 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.611015 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.611153 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.611334 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.611471 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.611641 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.611770 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.611947 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.612075 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.612251 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.612567 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.612567 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.612816 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.612977 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.613105 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.613230 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.613364 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.613507 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.613661 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.613806 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.613933 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.614066 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.614197 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.614358 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.614497 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.614662 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.614790 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.614974 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.615101 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.615278 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.615420 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.615586 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.615715 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.615886 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.616013 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.616189 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.616331 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.617007 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.617147 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.617317 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.617446 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.617636 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.617787 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.617924 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.618058 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.618229 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.618367 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.618547 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.618678 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.618867 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.618997 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.619175 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.619311 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.619484 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.619616 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.619790 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.619929 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.620110 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.620240 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.620429 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.620557 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.620738 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.620879 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.621047 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.621176 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.621353 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.621484 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.621697 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:29:38.621843 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.622034 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.622173 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.622368 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.622596 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.622791 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.622928 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.623066 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.623202 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.623335 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.623462 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.623588 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.623713 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.623909 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.624057 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.624224 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.624354 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.624545 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.624674 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.624865 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.624995 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.625189 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.625318 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.625506 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.625669 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.625845 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.625982 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.626164 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.626299 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.626478 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.626608 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.626797 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.626938 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.627115 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.627243 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.627436 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.627565 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.627767 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.627894 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.628057 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.628185 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.628376 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.628505 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.628709 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.628847 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.629032 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.629162 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.629347 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.629475 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.629704 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.629835 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.630021 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.630152 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.630336 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.630479 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.630660 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.630791 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.630983 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.631114 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.631297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.631433 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.631607 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.631736 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.631919 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.632056 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.632882 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.633037 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.633165 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.633301 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.633428 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.633619 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.633749 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.633890 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.634064 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.634195 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.634380 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.634508 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.634697 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.634837 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.635012 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.635150 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.635329 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.635458 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.635643 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.635773 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.635959 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.636097 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.636276 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.636415 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.636586 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.636717 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.636897 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.637027 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.637209 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.637339 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.637521 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.637674 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.637852 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.637981 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.638161 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.638289 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.638473 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.638613 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.638782 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.638912 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.639095 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.639239 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.639403 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.639542 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.639726 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.639856 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.640042 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.640186 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.640352 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.640493 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.640661 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.640790 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.640976 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.641115 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.641292 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.641422 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.641626 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.641757 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.641944 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.642092 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.642255 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.642390 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.642563 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.642705 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.642997 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.643136 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.643263 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.643397 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.643524 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.643657 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.643797 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.643928 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.644092 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.644230 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.644409 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.644540 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.644718 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.644848 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.645031 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.645159 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.645347 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.645485 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.645684 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.645818 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.645999 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.646120 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.646310 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.646449 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.646622 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.646760 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.646948 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.647079 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.647264 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.647402 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.647578 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.647708 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.647927 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.648056 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.648241 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.648379 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.648556 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.648686 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.648869 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.649000 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.649177 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.649322 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.649488 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.649649 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.649827 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.649969 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.650139 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.650275 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.650446 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.650576 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.650753 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.650882 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.651059 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.651197 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.651369 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.651528 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.651699 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.651830 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.652011 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.652143 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.652321 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.652443 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.652629 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.652759 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.652938 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.653197 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.653337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.653465 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.653610 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.653751 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.653944 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.654075 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.654252 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.654380 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.654561 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.654700 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.654907 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.655042 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.655222 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.655409 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.655548 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.655678 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.655871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.656008 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.656187 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.656317 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.656501 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.656644 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.656814 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.656950 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.657134 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.657263 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.657445 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.657701 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.657832 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.657965 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.658092 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.658225 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.658408 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.658546 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.658722 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.658852 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.659048 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.659186 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.659360 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.659492 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.659679 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.659809 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.660005 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.660134 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.660328 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.660460 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.660651 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.660779 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.660959 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.661088 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.661278 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.661410 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.661673 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.661807 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.661991 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.662134 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.662307 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.662444 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.662621 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.662751 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.662934 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.663078 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.663337 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.663517 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.663707 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.663840 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.663966 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.664102 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.664237 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.664364 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.664489 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.664614 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.664815 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.664952 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.665133 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.665261 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.665442 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.665624 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.665782 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.665928 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.666113 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.666253 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.666427 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.666566 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.666747 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.666877 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.667058 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.667186 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.667378 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.667508 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.667692 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.667830 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.668007 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.668136 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.668320 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.668450 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.668632 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.668763 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.668943 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.669073 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.669257 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.669387 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.669590 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.669725 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.669909 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.670052 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.670221 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.670358 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.670529 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.670658 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.670843 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.670975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.671154 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.671291 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.671462 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.671604 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.671769 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.671900 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.672079 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.672222 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.672398 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.672536 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.672709 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.672845 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.673014 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.673159 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.673427 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.673587 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.673730 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.673858 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.673992 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.674120 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.674268 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.674397 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.674578 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.674708 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.674885 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.675016 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.675190 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.675321 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.675495 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.675626 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.675822 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.675952 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.676135 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.676266 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.676439 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.676567 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.676744 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.676874 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.677051 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.677197 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.677370 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.677508 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.677710 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.677841 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.678020 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.678150 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.678328 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.678466 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.678653 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.678789 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.679472 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.679607 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.679788 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.679926 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.680102 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.680231 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.680413 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.680543 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.680727 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.680867 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.681040 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.681177 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.681351 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.681480 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.681689 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.681820 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.682000 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.682129 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.682311 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.682439 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.682618 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.682748 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.682932 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.683061 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.683244 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.683508 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.683657 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.683807 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.683939 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.684141 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.684271 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.684454 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.684594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.684770 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.684892 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.685091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.685325 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.685468 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.685689 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.685832 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.686008 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.686138 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.686329 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.686468 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.686677 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.687080 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.687209 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.687336 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.687542 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.687672 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.687851 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.687979 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.688162 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.688299 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.688471 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.688615 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.688777 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.688920 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.689083 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.689213 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.689390 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.689510 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.689728 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.689877 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.690035 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.690165 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.690341 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.690470 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.690646 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.690784 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.690957 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.691085 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.691261 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.691390 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.691567 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.691704 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.691874 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.692004 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.692180 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.692309 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.692496 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.692628 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.692801 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.692936 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.693108 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.693238 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.693414 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.693741 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.693873 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.694000 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.694126 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.694264 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.694401 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.694530 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.695277 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.695411 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.695537 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.695663 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.695835 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.695968 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.696146 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.696284 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.696488 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.696627 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.696821 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.696952 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.697144 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.697282 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.697455 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.697617 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.697796 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.697927 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.698109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.698247 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.698420 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.698560 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.698728 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.698867 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.699039 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.699177 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.699350 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.699488 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.699661 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.699790 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.699967 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.700097 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.700280 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.700411 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.700587 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.700717 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.700899 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.701028 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.701212 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.701342 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.701518 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.701698 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.701849 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.701979 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.702157 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.702287 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.702468 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.702606 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.702778 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.702917 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.703085 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.703214 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.703391 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.703533 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.703707 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.703847 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.704012 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.704110 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.704318 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.704404 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.704628 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.704722 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.704934 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.705021 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.705244 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.705328 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.705574 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.705742 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.705879 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.706019 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.706179 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.706331 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.706493 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.706643 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.706791 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.706927 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.707096 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.707227 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.707405 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.707536 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.707713 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.707843 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.708020 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.708148 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.708328 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.708459 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.708640 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.708771 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.708946 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.709076 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.709250 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.709379 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.709571 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.709702 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.709885 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.710027 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.710209 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.710344 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.710526 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.710656 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.710832 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.710972 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.711140 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.711268 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.711444 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.711572 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.711751 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.711963 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.712101 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.712228 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.712385 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.712512 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.712645 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.712781 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.712942 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.713105 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.713238 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.713364 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.713559 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.713706 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.713975 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.714107 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.714233 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.714359 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.714493 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.714621 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.714775 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.714905 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.715081 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.715213 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.715429 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.715560 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.715742 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.715880 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.716073 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.716203 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.716390 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.716521 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.716700 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.716829 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.717018 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.717147 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.717329 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.717458 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.717664 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.717793 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.717972 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.718115 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.718278 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.718418 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.718593 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.718723 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.718905 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.719042 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.719215 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.719342 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.719522 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.719651 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.719829 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.719969 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.720155 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.720285 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.720463 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.720590 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.720774 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.720911 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.721085 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.721213 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.721396 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.721525 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.721748 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.721893 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.722062 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.722192 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.722375 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.722505 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.722691 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.722822 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.723005 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.723135 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.723320 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.723452 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.723633 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.723765 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.724033 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.724174 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.724299 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.724432 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.724568 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.724694 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.724848 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.724977 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.725163 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.725292 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.725473 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.725624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.725824 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.726457 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.726637 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.726790 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.727039 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.727169 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.727303 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.727430 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.727565 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.727701 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.727912 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.728042 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.728224 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.728361 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.728534 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.728674 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.728847 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.728976 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.729157 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.729284 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.729473 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.729636 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.729821 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.729951 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.730138 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.730267 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.730449 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.730587 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.730811 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.730947 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.731129 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.731276 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.731450 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.731580 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.731764 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.731902 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.732071 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.732199 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.732376 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.732506 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.732702 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.732834 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.733031 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.733161 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.733341 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.733472 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.733721 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.733862 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.734002 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.734264 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.734401 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.734529 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.734654 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.734780 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.734906 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.735040 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.735228 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.735357 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.735544 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.735681 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.735872 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.736012 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.736182 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.736312 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.736510 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.736640 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.736915 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.737067 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.737259 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.737386 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.737519 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.737707 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.737900 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.738032 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.738210 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.738347 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.738528 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.738666 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.738843 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.738980 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.739173 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.739315 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.739501 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.739638 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.739811 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.739941 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.740126 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.740264 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.740437 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.740567 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.740764 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.740893 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.741089 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.741220 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.741401 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.742091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.742293 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.742423 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.742629 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.742752 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.742960 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.743091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.743289 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.743420 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.743606 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.743735 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.743934 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.744064 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.744281 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.744420 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.744556 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.744683 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.744865 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.744996 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.745176 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.745319 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.745484 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.745666 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.745838 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.745968 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.746149 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.746293 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.746465 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.746597 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.746782 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.746911 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.747098 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.747242 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.747434 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.747563 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.747687 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.747812 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.748020 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.748150 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.748328 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.748458 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.748641 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.748768 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.748955 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.749085 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.749265 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.749394 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.749615 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.749760 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.749926 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.750055 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.750252 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.750380 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.750570 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.750709 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.750882 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.751018 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.751193 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.751330 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.751505 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.751642 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.751833 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.751961 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.752151 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.752279 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.752462 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.752636 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.752765 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.752891 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.753071 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.753200 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.753419 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.753585 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.753754 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.753885 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.754080 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.754220 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.754435 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.754565 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.754720 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.754852 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.755040 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.755169 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.755347 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.755477 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.755657 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.755787 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.755972 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.756111 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.756281 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.756415 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.756588 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.756718 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.756897 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.757038 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.757236 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.757373 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.757607 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.757738 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.757864 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.758010 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.758146 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.758274 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.758462 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.758590 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.758767 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.758905 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.759072 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.759201 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.759390 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.759519 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.759697 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.759905 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.760035 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.760162 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.760297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.760425 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.760627 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.760759 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.760935 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.761065 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.761271 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.761407 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.761606 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.761739 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.761916 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.762046 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.762251 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.762381 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.762556 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.762686 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.762881 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.763011 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.763198 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.763327 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.763513 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.763642 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.763830 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.763961 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.764139 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.764277 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.764484 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.764621 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.764756 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.764883 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.765075 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.765214 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.765389 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.765526 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.765729 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.765858 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.766047 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.766190 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.766363 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.766492 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.766677 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.766884 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.767014 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.767212 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.767511 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.767715 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.767830 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.767937 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.768086 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.768227 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.768404 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.768544 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.768737 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.768867 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.769054 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.769184 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.769366 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.769495 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.769703 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.769833 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.770017 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.770149 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.770329 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.770458 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.770643 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.770774 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.770957 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.771089 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.771271 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.771409 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.771583 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.771723 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.771912 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.772042 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.772228 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.772357 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.772547 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.772708 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.772913 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.773035 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.773236 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.773367 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.773561 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.773694 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.773885 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.774017 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.774201 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.774329 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.774598 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.774738 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.774869 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.774995 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.775120 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.775256 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.775441 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.775573 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.775758 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.775889 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.776073 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.776214 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.776384 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.776513 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.776698 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.776839 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.777011 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.777154 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.777325 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.777456 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.777662 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.777869 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.778015 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.778144 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.778278 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.778413 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.778578 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.778709 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.778905 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.779037 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.779243 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.779428 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.779559 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.779751 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.779890 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.780090 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.780221 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.780421 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.780552 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.780754 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.780985 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.781127 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.781310 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.781441 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.781675 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.781818 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.782012 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.782143 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.782322 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.782459 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.782637 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.782777 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.782950 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.783082 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.783258 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.783390 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.783581 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.783719 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.783891 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.784021 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.784198 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.784329 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.784508 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.784661 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.784853 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.784990 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.785117 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.785342 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.785483 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.785724 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.785856 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.786045 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.786177 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.786377 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.786517 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.786710 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.786978 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.787110 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.787330 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.787460 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.787651 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.787782 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.787999 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.788129 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.788255 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.788901 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.789075 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.789205 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.789392 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.789530 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.789729 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.789873 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.790041 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.790184 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.790354 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.790484 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.790667 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.790805 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.790979 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.791139 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.791288 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.791416 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.791595 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.791734 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.791907 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.792044 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.792223 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.792353 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.792533 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.792670 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.792845 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.792973 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.793153 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.793283 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.793462 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.793670 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.793810 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.793938 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.794098 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.794235 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.794408 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.794540 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.794725 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.794869 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.795060 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.795189 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.795325 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.795453 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.795624 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.795769 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.795933 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.796081 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.796241 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.796371 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.796551 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.796679 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.796867 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.797074 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.797203 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.797330 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.797463 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.797609 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.797801 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.797945 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.798153 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.798282 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.798444 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.798573 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.798772 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.798916 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.799082 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.799213 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.799392 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.799522 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.799710 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.799849 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.800026 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.800157 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.800354 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.800571 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.800716 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.800914 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.801046 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.801239 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.801369 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.801597 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.801746 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.801938 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.802159 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.802298 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.802498 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.802628 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.802823 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.802957 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.803159 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.803297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.803473 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.803612 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.803791 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.803942 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.804640 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.804772 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.804963 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.805180 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.805312 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.805438 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.805604 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.805736 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.805922 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.806061 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.806235 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.806363 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.806548 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.806685 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.806858 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.806996 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.807169 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.807299 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.807479 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.807608 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.807791 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.807921 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.808103 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.808318 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.808448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.808583 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.808722 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.808857 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.809008 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.809138 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.809324 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.809456 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.809688 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.809827 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.810005 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.810135 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.810317 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.810457 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.810632 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.810762 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.810947 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.811076 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.811262 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.811409 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.811576 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.811707 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.812156 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.812285 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.812469 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.812612 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.812787 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.812918 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.813118 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.813251 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.813439 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.813593 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.813772 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.813902 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.814151 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.814279 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.814479 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.814613 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.814794 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.814924 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.815114 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.815319 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.815458 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.815586 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.815741 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.815880 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.816072 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.816212 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.816396 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.816526 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.816723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.816861 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.817037 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.817176 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.817346 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.817475 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.817680 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.817812 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.817994 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.818135 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.818352 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.818499 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.818628 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.818754 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.818926 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.819057 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.819233 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.819363 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.819564 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.819697 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.819878 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.820009 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.820185 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.820316 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.820489 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.820618 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.820794 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.820925 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.821104 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.821241 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.821410 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.821604 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.821752 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.821881 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.822038 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.822169 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.822346 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.822485 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.822652 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.822783 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.822959 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.823097 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.823271 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.823410 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.823575 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.823704 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.823880 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.824009 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.824183 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.824321 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.824486 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.824616 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.824793 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.824932 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.825098 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.825236 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.825441 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.825593 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.825722 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.825849 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.826016 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.826150 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.826328 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.826466 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.826664 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.826795 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.826994 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.827123 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.827306 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.827438 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.827633 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.827764 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.827947 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.828077 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.828258 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.828402 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.828592 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.828727 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.828864 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.828992 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.829188 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.829333 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.829502 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.829665 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.829841 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.829973 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.830155 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.830294 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.830469 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.830613 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.830783 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.830913 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.831099 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.831229 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.831407 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.831583 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.831712 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.831836 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.832018 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.832148 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.832348 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.832480 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.832666 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.832795 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.832982 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.833111 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.833313 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.833451 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.833651 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.833783 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.833967 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.834106 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.834285 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.834415 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.834598 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.834727 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.834930 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.835069 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.835269 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.835422 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.835623 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.835755 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.835881 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.836020 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.836199 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.836330 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.836515 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.836647 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.836838 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.836977 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.837159 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.837289 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.837492 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.837643 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.837846 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.837990 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.838178 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.838309 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.838498 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.838709 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.838848 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.838976 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.839110 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.839238 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.839365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 07:29:38.839498 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.839804 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.840123 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.840438 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.840748 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:29:38.840993 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 07:29:38.865773 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_db.sqlalchemy.engines [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:29:38.867323 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG oslo_db.sqlalchemy.engines [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:29:38.930139 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.context [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c793e13-41c1-4464-88e9-f3c40625395f(cell1) {{(pid=102827) load_cells /opt/stack/nova/nova/context.py:464}} May 11 07:29:38.930364 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.context [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c793e13-41c1-4464-88e9-f3c40625395f(cell1) {{(pid=102828) load_cells /opt/stack/nova/nova/context.py:464}} May 11 07:29:38.934453 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG oslo_concurrency.lockutils [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:29:38.934580 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:29:38.936002 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:29:38.936106 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG oslo_concurrency.lockutils [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:29:38.937053 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG oslo_concurrency.lockutils [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:29:38.937159 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:29:38.938991 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG oslo_concurrency.lockutils [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:29:38.939141 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:29:38.949672 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG oslo_db.sqlalchemy.engines [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:29:38.953259 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_db.sqlalchemy.engines [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:29:38.958304 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_db.sqlalchemy.engines [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:29:39.090113 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG oslo_db.sqlalchemy.engines [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:29:39.111573 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG oslo_db.sqlalchemy.engines [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:29:39.117940 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_db.sqlalchemy.engines [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:29:39.447995 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: WARNING keystonemiddleware.auth_token [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 07:29:39.452615 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: WARNING keystonemiddleware.auth_token [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 07:29:39.455371 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: WARNING keystonemiddleware.auth_token [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 07:29:39.459972 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: WARNING keystonemiddleware.auth_token [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 07:29:39.798500 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: WARNING keystonemiddleware.auth_token [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 07:29:39.800396 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: WARNING keystonemiddleware.auth_token [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 07:29:39.805076 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: WARNING keystonemiddleware.auth_token [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 07:29:39.807172 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: WARNING keystonemiddleware.auth_token [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 07:29:39.811114 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55df103739c0 pid: 102828 (default app) May 11 07:29:39.813436 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:29:39.813571 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55df103739c0 pid: 102827 (default app) May 11 07:29:39.814663 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-f3684b4f-dc4f-44e4-81f6-16e7be7334b2 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001778 May 11 07:29:39.815079 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Wed May 11 07:29:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:30:58.218937 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:30:58.220156 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001931 May 11 07:30:58.220564 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 930 bytes} [Wed May 11 07:30:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:30:58.650057 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-5ffe080a-1fcd-4628-9eb8-e52c3f9ea954 admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:30:58.680092 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-5ffe080a-1fcd-4628-9eb8-e52c3f9ea954 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.452753 May 11 07:30:58.689598 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1291 bytes} [Wed May 11 07:30:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:31:00.960725 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:00.961780 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-3e4d28da-2a96-42cd-9ccf-15c7bf05f452 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 11 07:31:00.962170 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 2/4] 10.222.0.36 () {54 vars in 930 bytes} [Wed May 11 07:31:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:01.029135 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-f4321edb-0c68-44e6-8919-af2b09faf311 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:01.049588 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 07:31:01.049588 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: warnings.warn(msg) May 11 07:31:01.081135 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-f4321edb-0c68-44e6-8919-af2b09faf311 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.113154 May 11 07:31:01.081930 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 3/5] 10.222.0.36 () {64 vars in 1282 bytes} [Wed May 11 07:31:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:31:01.294393 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-8f95469e-5ae3-44a0-b94c-e5078bee2136 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:01.296809 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 07:31:01.296809 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: warnings.warn(msg) May 11 07:31:01.349798 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-8f95469e-5ae3-44a0-b94c-e5078bee2136 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.258530 May 11 07:31:01.350226 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 3/6] 10.222.0.36 () {64 vars in 1335 bytes} [Wed May 11 07:31:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:31:03.672313 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-f4321edb-0c68-44e6-8919-af2b09faf311 admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:03.673954 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-f4321edb-0c68-44e6-8919-af2b09faf311 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 May 11 07:31:03.674365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 4/7] 10.222.0.36 () {54 vars in 930 bytes} [Wed May 11 07:31:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:03.780577 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-3f221619-5d1c-475a-b5e3-c9f368883c41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:03.798831 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 07:31:03.798831 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: warnings.warn(msg) May 11 07:31:03.817718 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-3f221619-5d1c-475a-b5e3-c9f368883c41 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136992 May 11 07:31:03.818276 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 4/8] 10.222.0.36 () {64 vars in 1282 bytes} [Wed May 11 07:31:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 07:31:03.829863 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-00b5f469-55c7-434a-b2bb-3eac1815fbdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:03.831434 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 07:31:03.831434 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: warnings.warn(msg) May 11 07:31:03.864636 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-00b5f469-55c7-434a-b2bb-3eac1815fbdd admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038467 May 11 07:31:03.865201 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 5/9] 10.222.0.36 () {64 vars in 1335 bytes} [Wed May 11 07:31:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:31:06.130952 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-3f221619-5d1c-475a-b5e3-c9f368883c41 admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:06.131949 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-3f221619-5d1c-475a-b5e3-c9f368883c41 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 11 07:31:06.132373 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 930 bytes} [Wed May 11 07:31:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:06.200058 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-ed6199d7-d675-414a-839e-028a114fad35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d2", "vcpus": 1, "name": "ds1G"}} {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:06.220082 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-ed6199d7-d675-414a-839e-028a114fad35 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081784 May 11 07:31:06.220770 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 6/11] 10.222.0.36 () {64 vars in 1282 bytes} [Wed May 11 07:31:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:31:06.233325 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-69249118-cb58-4078-ab8f-e8ca5edb6003 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:06.255701 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-69249118-cb58-4078-ab8f-e8ca5edb6003 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026270 May 11 07:31:06.256491 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 6/12] 10.222.0.36 () {64 vars in 1335 bytes} [Wed May 11 07:31:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:31:08.519544 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-ed6199d7-d675-414a-839e-028a114fad35 admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:08.520610 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-ed6199d7-d675-414a-839e-028a114fad35 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 May 11 07:31:08.521231 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 7/13] 10.222.0.36 () {54 vars in 930 bytes} [Wed May 11 07:31:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:08.581507 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-1f1d081f-2137-40e0-b48b-455b5d4c3609 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "vcpus": 2, "disk": 10, "swap": 0}} {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:08.599434 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-1f1d081f-2137-40e0-b48b-455b5d4c3609 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071921 May 11 07:31:08.600111 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 7/14] 10.222.0.36 () {64 vars in 1282 bytes} [Wed May 11 07:31:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:31:08.611880 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-48df3c97-b1c2-4d1d-8952-1af4feba2a55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:08.635111 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-48df3c97-b1c2-4d1d-8952-1af4feba2a55 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026955 May 11 07:31:08.635686 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 8/15] 10.222.0.36 () {64 vars in 1335 bytes} [Wed May 11 07:31:08 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:31:10.924664 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-1f1d081f-2137-40e0-b48b-455b5d4c3609 admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:10.925724 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-1f1d081f-2137-40e0-b48b-455b5d4c3609 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 11 07:31:10.926132 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 8/16] 10.222.0.36 () {54 vars in 930 bytes} [Wed May 11 07:31:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:10.986320 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-417c4310-ff78-49c0-9e8f-9dd8041c33ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4}} {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:11.007425 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-417c4310-ff78-49c0-9e8f-9dd8041c33ef admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075516 May 11 07:31:11.008347 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 9/17] 10.222.0.36 () {64 vars in 1282 bytes} [Wed May 11 07:31:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:31:11.020780 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-ab9dcbff-575b-4147-8661-8fa340fb50a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:11.044769 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-ab9dcbff-575b-4147-8661-8fa340fb50a9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028527 May 11 07:31:11.045628 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 9/18] 10.222.0.36 () {64 vars in 1335 bytes} [Wed May 11 07:31:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:31:13.303061 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-417c4310-ff78-49c0-9e8f-9dd8041c33ef admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:13.304066 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-417c4310-ff78-49c0-9e8f-9dd8041c33ef admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 11 07:31:13.304470 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 10/19] 10.222.0.36 () {54 vars in 930 bytes} [Wed May 11 07:31:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:13.365694 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-ad2d65cc-8701-4723-8eee-c8c8760130ea admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:13.391678 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-ad2d65cc-8701-4723-8eee-c8c8760130ea admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080978 May 11 07:31:13.392267 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1291 bytes} [Wed May 11 07:31:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:31:15.875978 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-417c4310-ff78-49c0-9e8f-9dd8041c33ef admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:15.877027 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-417c4310-ff78-49c0-9e8f-9dd8041c33ef admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 May 11 07:31:15.877441 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 930 bytes} [Wed May 11 07:31:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:15.948153 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-a00c9c99-a797-46cb-8e41-afee941f82df admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1"}} {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:15.965887 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-a00c9c99-a797-46cb-8e41-afee941f82df admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081634 May 11 07:31:15.966437 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 11/22] 10.222.0.36 () {64 vars in 1282 bytes} [Wed May 11 07:31:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 07:31:15.978342 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-ebb20091-8b59-4bea-819d-ff6a78dc4eb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:16.005587 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-ebb20091-8b59-4bea-819d-ff6a78dc4eb8 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030414 May 11 07:31:16.006493 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 12/23] 10.222.0.36 () {64 vars in 1332 bytes} [Wed May 11 07:31:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:31:18.589790 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-a00c9c99-a797-46cb-8e41-afee941f82df admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:18.590795 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-a00c9c99-a797-46cb-8e41-afee941f82df admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 May 11 07:31:18.591204 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 930 bytes} [Wed May 11 07:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:18.656436 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-157c7e55-378c-4cdc-97c1-893e928dbe48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:18.676312 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-157c7e55-378c-4cdc-97c1-893e928dbe48 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078730 May 11 07:31:18.677218 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 13/25] 10.222.0.36 () {64 vars in 1282 bytes} [Wed May 11 07:31:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:31:18.689268 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-381ede99-26ce-404a-92e3-9789e4db2599 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:18.710853 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-381ede99-26ce-404a-92e3-9789e4db2599 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025485 May 11 07:31:18.711456 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 13/26] 10.222.0.36 () {64 vars in 1332 bytes} [Wed May 11 07:31:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:31:20.974210 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-157c7e55-378c-4cdc-97c1-893e928dbe48 admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:20.975222 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-157c7e55-378c-4cdc-97c1-893e928dbe48 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 11 07:31:20.975777 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 930 bytes} [Wed May 11 07:31:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:21.032283 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-1f155b66-fd22-4e5b-a33a-fbbf20639802 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "id": "3", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:21.049296 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-1f155b66-fd22-4e5b-a33a-fbbf20639802 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068077 May 11 07:31:21.049876 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 14/28] 10.222.0.36 () {64 vars in 1282 bytes} [Wed May 11 07:31:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:31:21.061728 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-d1340ee5-c3e8-4a77-a74f-3205eb805599 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:21.084460 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-d1340ee5-c3e8-4a77-a74f-3205eb805599 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026674 May 11 07:31:21.085027 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 15/29] 10.222.0.36 () {64 vars in 1332 bytes} [Wed May 11 07:31:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:31:23.333727 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-1f155b66-fd22-4e5b-a33a-fbbf20639802 admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:23.334786 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-1f155b66-fd22-4e5b-a33a-fbbf20639802 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 May 11 07:31:23.335212 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 15/30] 10.222.0.36 () {54 vars in 930 bytes} [Wed May 11 07:31:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:23.400697 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-7e9a3f03-0af1-4dd8-8275-f684eb4bc694 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "ram": 8192, "swap": 0}} {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:23.419436 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-7e9a3f03-0af1-4dd8-8275-f684eb4bc694 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078123 May 11 07:31:23.419980 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 16/31] 10.222.0.36 () {64 vars in 1282 bytes} [Wed May 11 07:31:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:31:23.432226 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-24d603bf-3ebd-4c65-8433-d93a9a59a190 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:23.457238 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-24d603bf-3ebd-4c65-8433-d93a9a59a190 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028640 May 11 07:31:23.457946 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 16/32] 10.222.0.36 () {64 vars in 1332 bytes} [Wed May 11 07:31:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:31:25.744760 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-7e9a3f03-0af1-4dd8-8275-f684eb4bc694 admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:25.745725 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-7e9a3f03-0af1-4dd8-8275-f684eb4bc694 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 11 07:31:25.746608 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 930 bytes} [Wed May 11 07:31:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:25.806209 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-0fb129a3-2665-49ee-bf33-ea5f91e69c8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:25.825140 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-0fb129a3-2665-49ee-bf33-ea5f91e69c8a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073243 May 11 07:31:25.825879 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 17/34] 10.222.0.36 () {64 vars in 1282 bytes} [Wed May 11 07:31:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:31:25.838031 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-4a0989ca-9c42-4a40-ac38-1bbfd9825ae8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:25.860734 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-4a0989ca-9c42-4a40-ac38-1bbfd9825ae8 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026244 May 11 07:31:25.861326 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 18/35] 10.222.0.36 () {64 vars in 1332 bytes} [Wed May 11 07:31:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:31:49.992867 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-0fb129a3-2665-49ee-bf33-ea5f91e69c8a admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:49.993897 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-0fb129a3-2665-49ee-bf33-ea5f91e69c8a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 May 11 07:31:49.994290 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 930 bytes} [Wed May 11 07:31:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:50.049135 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-6227a1b8-950d-45c6-a3dd-05b51b98cc37 admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:50.066454 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-6227a1b8-950d-45c6-a3dd-05b51b98cc37 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066350 May 11 07:31:50.066973 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1291 bytes} [Wed May 11 07:31:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:31:51.059969 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-0fb129a3-2665-49ee-bf33-ea5f91e69c8a admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:51.060961 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-0fb129a3-2665-49ee-bf33-ea5f91e69c8a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 May 11 07:31:51.061358 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1074 bytes} [Wed May 11 07:31:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:51.250953 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-aad89c5d-d1a8-45cc-95a6-23be2cd1c0c2 admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:51.257080 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.wsgi [None req-aad89c5d-d1a8-45cc-95a6-23be2cd1c0c2 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-aad89c5d-d1a8-45cc-95a6-23be2cd1c0c2 admin admin] Request method failure captured: May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Accept: application/json May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Accept-Encoding: gzip, deflate May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Connection: keep-alive May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Content-Length: 0 May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Host: 10.222.0.36 May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Openstack-Api-Version: compute 2.90 May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Openstack-System-Scope: None May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: User-Agent: python-novaclient May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Auth-Token: gAAAAABie2ZnevVi9SuCHTT4_NvXSZLCP4g6nRe2xNeKpUvNHhoBMZwII6TSSqJFTFYI2E_P-RVi3aTIbsrEmScQJtugta_m0VHYIW2Rh0DEyDQ-s6KIZzG38CHAEellWiI0WN1qA2QOZJ9AFMIX9-bdHALK2-B5Y1eQIGfDYlwoNDVpxmQmw3Q May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Domain-Id: None May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Domain-Name: None May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Identity-Status: Confirmed May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Is-Admin-Project: True May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Openstack-Nova-Api-Version: 2.90 May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Project-Domain-Id: default May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Project-Domain-Name: Default May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Project-Id: 5da8d434269248bf956fab772dd66ddd May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Project-Name: admin May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Role: admin,reader,member May 11 07:31:51.260297 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Roles: admin,reader,member May 11 07:31:51.261975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5da8d434269248bf956fab772dd66ddd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5da8d434269248bf956fab772dd66ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5da8d434269248bf956fab772dd66ddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5da8d434269248bf956fab772dd66ddd"}]}] May 11 07:31:51.261975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Tenant: admin May 11 07:31:51.261975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Tenant-Id: 5da8d434269248bf956fab772dd66ddd May 11 07:31:51.261975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Tenant-Name: admin May 11 07:31:51.261975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User: admin May 11 07:31:51.261975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User-Domain-Id: default May 11 07:31:51.261975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User-Domain-Name: Default May 11 07:31:51.261975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User-Id: 2752110942d445b6bd51fbda49f0d6b8 May 11 07:31:51.261975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User-Name: admin May 11 07:31:51.261975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: method: > May 11 07:31:51.261975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: exception: Flavor 42 could not be found. May 11 07:31:51.261975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: action_args: {'id': '42'} May 11 07:31:51.261975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:31:51.261975 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:31:51.263016 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:51.264337 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-aad89c5d-d1a8-45cc-95a6-23be2cd1c0c2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:31:51.265692 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-aad89c5d-d1a8-45cc-95a6-23be2cd1c0c2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060917 May 11 07:31:51.265692 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1190 bytes} [Wed May 11 07:31:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 07:31:51.271504 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-4d5e0345-6b0f-4450-8002-9f9e5d6f878e admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:51.291314 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-4d5e0345-6b0f-4450-8002-9f9e5d6f878e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023426 May 11 07:31:51.291828 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1210 bytes} [Wed May 11 07:31:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 07:31:51.308451 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-fa42c21e-3a23-4af2-9c4a-680b847f62eb admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:51.329649 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-fa42c21e-3a23-4af2-9c4a-680b847f62eb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024690 May 11 07:31:51.330171 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1210 bytes} [Wed May 11 07:31:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:31:51.339208 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-36e1d335-9a0e-4718-8ecc-b631951207b2 admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:51.344492 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.wsgi [None req-36e1d335-9a0e-4718-8ecc-b631951207b2 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-36e1d335-9a0e-4718-8ecc-b631951207b2 admin admin] Request method failure captured: May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Accept: application/json May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Accept-Encoding: gzip, deflate May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Connection: keep-alive May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Content-Length: 0 May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Host: 10.222.0.36 May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Openstack-Api-Version: compute 2.90 May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Openstack-System-Scope: None May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: User-Agent: python-novaclient May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Auth-Token: gAAAAABie2ZnevVi9SuCHTT4_NvXSZLCP4g6nRe2xNeKpUvNHhoBMZwII6TSSqJFTFYI2E_P-RVi3aTIbsrEmScQJtugta_m0VHYIW2Rh0DEyDQ-s6KIZzG38CHAEellWiI0WN1qA2QOZJ9AFMIX9-bdHALK2-B5Y1eQIGfDYlwoNDVpxmQmw3Q May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Domain-Id: None May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Domain-Name: None May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Identity-Status: Confirmed May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Is-Admin-Project: True May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Openstack-Nova-Api-Version: 2.90 May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Project-Domain-Id: default May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Project-Domain-Name: Default May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Project-Id: 5da8d434269248bf956fab772dd66ddd May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Project-Name: admin May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Role: admin,reader,member May 11 07:31:51.347723 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Roles: admin,reader,member May 11 07:31:51.349200 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5da8d434269248bf956fab772dd66ddd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5da8d434269248bf956fab772dd66ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5da8d434269248bf956fab772dd66ddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5da8d434269248bf956fab772dd66ddd"}]}] May 11 07:31:51.349200 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Tenant: admin May 11 07:31:51.349200 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Tenant-Id: 5da8d434269248bf956fab772dd66ddd May 11 07:31:51.349200 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Tenant-Name: admin May 11 07:31:51.349200 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User: admin May 11 07:31:51.349200 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User-Domain-Id: default May 11 07:31:51.349200 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User-Domain-Name: Default May 11 07:31:51.349200 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User-Id: 2752110942d445b6bd51fbda49f0d6b8 May 11 07:31:51.349200 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User-Name: admin May 11 07:31:51.349200 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: method: > May 11 07:31:51.349200 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: exception: Flavor 42 could not be found. May 11 07:31:51.349200 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: action_args: {'id': '42'} May 11 07:31:51.349200 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:31:51.349200 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:31:51.350210 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:51.351476 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-36e1d335-9a0e-4718-8ecc-b631951207b2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:31:51.352686 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-36e1d335-9a0e-4718-8ecc-b631951207b2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013351 May 11 07:31:51.352686 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1190 bytes} [Wed May 11 07:31:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 07:31:52.237944 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-fa42c21e-3a23-4af2-9c4a-680b847f62eb admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:52.238954 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-fa42c21e-3a23-4af2-9c4a-680b847f62eb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 11 07:31:52.239358 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 22/43] 10.222.0.36 () {56 vars in 1074 bytes} [Wed May 11 07:31:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:52.425734 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-9786e12f-5bb9-4690-b739-4a06a363c62f admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:52.430909 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.wsgi [None req-9786e12f-5bb9-4690-b739-4a06a363c62f admin admin] HTTP exception thrown: Flavor 84 could not be found. May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-9786e12f-5bb9-4690-b739-4a06a363c62f admin admin] Request method failure captured: May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Accept: application/json May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Accept-Encoding: gzip, deflate May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Connection: keep-alive May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Content-Length: 0 May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Host: 10.222.0.36 May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Openstack-Api-Version: compute 2.90 May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Openstack-System-Scope: None May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: User-Agent: python-novaclient May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Auth-Token: gAAAAABie2ZoMiHiXyFIaX-d9AZe7MCgVkwEuFN3WZrF6nBV1wK4ywR0QDc_bfy6rVLonV1lby24nQS94nK7Ocy7gq24BLu8vfzSOYwZ9DFst98Pz4qnOEPmQ37t0qzOxKdmmF9OPNqPvQPJYtsZ0RmICHX7guldobzeliY7_DVsahqHHQ-VPGI May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Domain-Id: None May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Domain-Name: None May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Identity-Status: Confirmed May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Is-Admin-Project: True May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Openstack-Nova-Api-Version: 2.90 May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Project-Domain-Id: default May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Project-Domain-Name: Default May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Project-Id: 5da8d434269248bf956fab772dd66ddd May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Project-Name: admin May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Role: admin,reader,member May 11 07:31:52.432375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Roles: admin,reader,member May 11 07:31:52.433766 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5da8d434269248bf956fab772dd66ddd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5da8d434269248bf956fab772dd66ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5da8d434269248bf956fab772dd66ddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5da8d434269248bf956fab772dd66ddd"}]}] May 11 07:31:52.433766 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Tenant: admin May 11 07:31:52.433766 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Tenant-Id: 5da8d434269248bf956fab772dd66ddd May 11 07:31:52.433766 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Tenant-Name: admin May 11 07:31:52.433766 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User: admin May 11 07:31:52.433766 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User-Domain-Id: default May 11 07:31:52.433766 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User-Domain-Name: Default May 11 07:31:52.433766 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User-Id: 2752110942d445b6bd51fbda49f0d6b8 May 11 07:31:52.433766 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User-Name: admin May 11 07:31:52.433766 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: method: > May 11 07:31:52.433766 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: exception: Flavor 84 could not be found. May 11 07:31:52.433766 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: action_args: {'id': '84'} May 11 07:31:52.433766 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:31:52.433766 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:31:52.434584 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:52.435931 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-9786e12f-5bb9-4690-b739-4a06a363c62f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:31:52.437403 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-9786e12f-5bb9-4690-b739-4a06a363c62f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058895 May 11 07:31:52.437403 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1190 bytes} [Wed May 11 07:31:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 11 07:31:52.444155 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-4903624e-bb01-4f58-b3fe-2aba0f7a5f6f admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:52.458275 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-4903624e-bb01-4f58-b3fe-2aba0f7a5f6f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018173 May 11 07:31:52.458756 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1210 bytes} [Wed May 11 07:31:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:31:52.468029 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-fa49f9ad-5514-41a6-a937-ef5756ed312e admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:52.481344 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-fa49f9ad-5514-41a6-a937-ef5756ed312e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016748 May 11 07:31:52.481893 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1210 bytes} [Wed May 11 07:31:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 07:31:52.491125 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-8f6ac846-b051-41c3-a3fe-d73221761ebb admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:52.496336 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.wsgi [None req-8f6ac846-b051-41c3-a3fe-d73221761ebb admin admin] HTTP exception thrown: Flavor 84 could not be found. May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-8f6ac846-b051-41c3-a3fe-d73221761ebb admin admin] Request method failure captured: May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Accept: application/json May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Accept-Encoding: gzip, deflate May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Connection: keep-alive May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Content-Length: 0 May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Host: 10.222.0.36 May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Openstack-Api-Version: compute 2.90 May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Openstack-System-Scope: None May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: User-Agent: python-novaclient May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Auth-Token: gAAAAABie2ZoMiHiXyFIaX-d9AZe7MCgVkwEuFN3WZrF6nBV1wK4ywR0QDc_bfy6rVLonV1lby24nQS94nK7Ocy7gq24BLu8vfzSOYwZ9DFst98Pz4qnOEPmQ37t0qzOxKdmmF9OPNqPvQPJYtsZ0RmICHX7guldobzeliY7_DVsahqHHQ-VPGI May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Domain-Id: None May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Domain-Name: None May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Identity-Status: Confirmed May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Is-Admin-Project: True May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Openstack-Nova-Api-Version: 2.90 May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Project-Domain-Id: default May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Project-Domain-Name: Default May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Project-Id: 5da8d434269248bf956fab772dd66ddd May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Project-Name: admin May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Role: admin,reader,member May 11 07:31:52.497871 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Roles: admin,reader,member May 11 07:31:52.499365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5da8d434269248bf956fab772dd66ddd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5da8d434269248bf956fab772dd66ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5da8d434269248bf956fab772dd66ddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5da8d434269248bf956fab772dd66ddd"}]}] May 11 07:31:52.499365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Tenant: admin May 11 07:31:52.499365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Tenant-Id: 5da8d434269248bf956fab772dd66ddd May 11 07:31:52.499365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Tenant-Name: admin May 11 07:31:52.499365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User: admin May 11 07:31:52.499365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User-Domain-Id: default May 11 07:31:52.499365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User-Domain-Name: Default May 11 07:31:52.499365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User-Id: 2752110942d445b6bd51fbda49f0d6b8 May 11 07:31:52.499365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User-Name: admin May 11 07:31:52.499365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: method: > May 11 07:31:52.499365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: exception: Flavor 84 could not be found. May 11 07:31:52.499365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: action_args: {'id': '84'} May 11 07:31:52.499365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:31:52.499365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:31:52.500308 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:52.501624 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-8f6ac846-b051-41c3-a3fe-d73221761ebb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:31:52.502859 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-8f6ac846-b051-41c3-a3fe-d73221761ebb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011663 May 11 07:31:52.502859 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1190 bytes} [Wed May 11 07:31:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 11 07:31:53.380776 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-fa49f9ad-5514-41a6-a937-ef5756ed312e admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:53.381798 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-fa49f9ad-5514-41a6-a937-ef5756ed312e admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 11 07:31:53.382192 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1074 bytes} [Wed May 11 07:31:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:53.567367 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-f60c1381-7bb7-4601-928a-114b24d1b56b admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:53.573043 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.wsgi [None req-f60c1381-7bb7-4601-928a-114b24d1b56b admin admin] HTTP exception thrown: Flavor 451 could not be found. May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-f60c1381-7bb7-4601-928a-114b24d1b56b admin admin] Request method failure captured: May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Accept: application/json May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Accept-Encoding: gzip, deflate May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Connection: keep-alive May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Content-Length: 0 May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Host: 10.222.0.36 May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Openstack-Api-Version: compute 2.90 May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Openstack-System-Scope: None May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: User-Agent: python-novaclient May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Auth-Token: gAAAAABie2ZpO6PvajAXHr6oh90HnG-HYL_-zqCs8ri-9MCtGVsBmKCfqZbQAnZYag-uJAJ2EgWCxsVxDKt7xO3CnR1Q6OenitAL3H9ZUCJfi2a9xUyQQTyDKoElO57c8FIPFwFfosSajP818XyjSFxud7ymrBdXASQmIZE-hOlFaSLKcw3kPYs May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Domain-Id: None May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Domain-Name: None May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Identity-Status: Confirmed May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Is-Admin-Project: True May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Openstack-Nova-Api-Version: 2.90 May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Project-Domain-Id: default May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Project-Domain-Name: Default May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Project-Id: 5da8d434269248bf956fab772dd66ddd May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Project-Name: admin May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Role: admin,reader,member May 11 07:31:53.574594 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Roles: admin,reader,member May 11 07:31:53.576109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5da8d434269248bf956fab772dd66ddd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5da8d434269248bf956fab772dd66ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5da8d434269248bf956fab772dd66ddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5da8d434269248bf956fab772dd66ddd"}]}] May 11 07:31:53.576109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Tenant: admin May 11 07:31:53.576109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Tenant-Id: 5da8d434269248bf956fab772dd66ddd May 11 07:31:53.576109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-Tenant-Name: admin May 11 07:31:53.576109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User: admin May 11 07:31:53.576109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User-Domain-Id: default May 11 07:31:53.576109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User-Domain-Name: Default May 11 07:31:53.576109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User-Id: 2752110942d445b6bd51fbda49f0d6b8 May 11 07:31:53.576109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: X-User-Name: admin May 11 07:31:53.576109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: method: > May 11 07:31:53.576109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: exception: Flavor 451 could not be found. May 11 07:31:53.576109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: action_args: {'id': '451'} May 11 07:31:53.576109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:31:53.576109 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:31:53.578091 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: ERROR nova.api.openstack.wsgi May 11 07:31:53.579223 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-f60c1381-7bb7-4601-928a-114b24d1b56b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:31:53.580186 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-f60c1381-7bb7-4601-928a-114b24d1b56b admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058921 May 11 07:31:53.580186 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 25/49] 10.222.0.36 () {60 vars in 1193 bytes} [Wed May 11 07:31:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 07:31:53.586103 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-451ce063-ece0-4f5d-bce9-ca484176e536 admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:53.600016 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-451ce063-ece0-4f5d-bce9-ca484176e536 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017408 May 11 07:31:53.600470 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 25/50] 10.222.0.36 () {60 vars in 1210 bytes} [Wed May 11 07:31:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:31:53.609657 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-2c22f681-4bff-4756-988e-a750b82e12ec admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:53.623106 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-2c22f681-4bff-4756-988e-a750b82e12ec admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016889 May 11 07:31:53.623631 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 26/51] 10.222.0.36 () {60 vars in 1210 bytes} [Wed May 11 07:31:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:31:53.632411 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-cd4927dc-3784-4e6a-b509-7b73bafa6d85 admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:53.637426 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.wsgi [None req-cd4927dc-3784-4e6a-b509-7b73bafa6d85 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-cd4927dc-3784-4e6a-b509-7b73bafa6d85 admin admin] Request method failure captured: May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Accept: application/json May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Accept-Encoding: gzip, deflate May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Connection: keep-alive May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Content-Length: 0 May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Host: 10.222.0.36 May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Openstack-Api-Version: compute 2.90 May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Openstack-System-Scope: None May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: User-Agent: python-novaclient May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Auth-Token: gAAAAABie2ZpO6PvajAXHr6oh90HnG-HYL_-zqCs8ri-9MCtGVsBmKCfqZbQAnZYag-uJAJ2EgWCxsVxDKt7xO3CnR1Q6OenitAL3H9ZUCJfi2a9xUyQQTyDKoElO57c8FIPFwFfosSajP818XyjSFxud7ymrBdXASQmIZE-hOlFaSLKcw3kPYs May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Domain-Id: None May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Domain-Name: None May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Identity-Status: Confirmed May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Is-Admin-Project: True May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Openstack-Nova-Api-Version: 2.90 May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Project-Domain-Id: default May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Project-Domain-Name: Default May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Project-Id: 5da8d434269248bf956fab772dd66ddd May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Project-Name: admin May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Role: admin,reader,member May 11 07:31:53.638953 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Roles: admin,reader,member May 11 07:31:53.640448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5da8d434269248bf956fab772dd66ddd", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5da8d434269248bf956fab772dd66ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5da8d434269248bf956fab772dd66ddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5da8d434269248bf956fab772dd66ddd"}]}] May 11 07:31:53.640448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Tenant: admin May 11 07:31:53.640448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Tenant-Id: 5da8d434269248bf956fab772dd66ddd May 11 07:31:53.640448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-Tenant-Name: admin May 11 07:31:53.640448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User: admin May 11 07:31:53.640448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User-Domain-Id: default May 11 07:31:53.640448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User-Domain-Name: Default May 11 07:31:53.640448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User-Id: 2752110942d445b6bd51fbda49f0d6b8 May 11 07:31:53.640448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: X-User-Name: admin May 11 07:31:53.640448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: method: > May 11 07:31:53.640448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: exception: Flavor 451 could not be found. May 11 07:31:53.640448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: action_args: {'id': '451'} May 11 07:31:53.640448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:31:53.640448 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:31:53.641391 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: ERROR nova.api.openstack.wsgi May 11 07:31:53.642691 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-cd4927dc-3784-4e6a-b509-7b73bafa6d85 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:31:53.644519 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-cd4927dc-3784-4e6a-b509-7b73bafa6d85 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011313 May 11 07:31:53.644519 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1193 bytes} [Wed May 11 07:31:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 07:31:54.514260 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-2c22f681-4bff-4756-988e-a750b82e12ec admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:54.515259 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-2c22f681-4bff-4756-988e-a750b82e12ec admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 11 07:31:54.515649 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 27/53] 10.222.0.36 () {56 vars in 1074 bytes} [Wed May 11 07:31:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:54.700330 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-9cef036a-efa2-4671-886c-026efa9e1728 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:54.718500 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-9cef036a-efa2-4671-886c-026efa9e1728 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068203 May 11 07:31:54.719045 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 27/54] 10.222.0.36 () {64 vars in 1235 bytes} [Wed May 11 07:31:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:31:55.602296 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-2c22f681-4bff-4756-988e-a750b82e12ec admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:55.603323 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-2c22f681-4bff-4756-988e-a750b82e12ec admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 11 07:31:55.603719 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1074 bytes} [Wed May 11 07:31:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:55.790115 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-63635f5b-e8f6-4d52-9a68-41d65ec03d17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:55.806763 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-63635f5b-e8f6-4d52-9a68-41d65ec03d17 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067341 May 11 07:31:55.807309 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 28/56] 10.222.0.36 () {64 vars in 1235 bytes} [Wed May 11 07:31:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:31:56.707415 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-2c22f681-4bff-4756-988e-a750b82e12ec admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:56.708410 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-2c22f681-4bff-4756-988e-a750b82e12ec admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 11 07:31:56.708814 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 29/57] 10.222.0.36 () {56 vars in 1074 bytes} [Wed May 11 07:31:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:56.894934 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-2f40822b-5653-46fa-a2e6-984334b61d96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:56.913071 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-2f40822b-5653-46fa-a2e6-984334b61d96 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069077 May 11 07:31:56.913635 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 29/58] 10.222.0.36 () {64 vars in 1235 bytes} [Wed May 11 07:31:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:31:57.800956 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-2c22f681-4bff-4756-988e-a750b82e12ec admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:57.802065 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-2c22f681-4bff-4756-988e-a750b82e12ec admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 May 11 07:31:57.802461 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1074 bytes} [Wed May 11 07:31:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:57.992571 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-ee4e7b05-c1fd-4c67-a1c2-59be06b5a96d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:31:58.010212 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-ee4e7b05-c1fd-4c67-a1c2-59be06b5a96d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067643 May 11 07:31:58.010681 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 30/60] 10.222.0.36 () {64 vars in 1235 bytes} [Wed May 11 07:31:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:31:58.895620 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-2c22f681-4bff-4756-988e-a750b82e12ec admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:58.896798 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-2c22f681-4bff-4756-988e-a750b82e12ec admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 May 11 07:31:58.897198 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 31/61] 10.222.0.36 () {56 vars in 1074 bytes} [Wed May 11 07:31:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:31:59.081581 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-c3bf75d9-17d5-4672-92ab-429530de47a6 admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:31:59.100816 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-c3bf75d9-17d5-4672-92ab-429530de47a6 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068595 May 11 07:31:59.101342 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 31/62] 10.222.0.36 () {60 vars in 1202 bytes} [Wed May 11 07:31:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:33:00.887642 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-2c22f681-4bff-4756-988e-a750b82e12ec admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:33:00.888606 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-2c22f681-4bff-4756-988e-a750b82e12ec admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 11 07:33:00.889000 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 32/63] 10.222.0.36 () {54 vars in 930 bytes} [Wed May 11 07:33:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:33:00.945720 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-b2161197-7140-4800-b571-1a8e8d5e3865 admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:33:00.964645 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-b2161197-7140-4800-b571-1a8e8d5e3865 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069482 May 11 07:33:00.965164 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 32/64] 10.222.0.36 () {60 vars in 1291 bytes} [Wed May 11 07:33:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:33:00.987769 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-ff6f4986-76bc-43a2-a6c2-25b55ba6403f admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:33:00.995168 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-ff6f4986-76bc-43a2-a6c2-25b55ba6403f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011790 May 11 07:33:00.995688 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 33/65] 10.222.0.36 () {60 vars in 1282 bytes} [Wed May 11 07:33:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:33:01.006857 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-2486c9ae-428c-4861-ae5f-7686bc730518 admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:33:01.014326 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-2486c9ae-428c-4861-ae5f-7686bc730518 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011044 May 11 07:33:01.014826 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 33/66] 10.222.0.36 () {60 vars in 1285 bytes} [Wed May 11 07:33:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:33:01.026059 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-b1f2ee6b-ec83-4216-ade1-c86fff395172 admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:33:01.033365 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-b1f2ee6b-ec83-4216-ade1-c86fff395172 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010736 May 11 07:33:01.033902 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 34/67] 10.222.0.36 () {60 vars in 1285 bytes} [Wed May 11 07:33:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:33:01.045112 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-91895340-aa08-421b-8717-1eb251a79614 admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:33:01.052375 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-91895340-aa08-421b-8717-1eb251a79614 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010719 May 11 07:33:01.052876 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 34/68] 10.222.0.36 () {60 vars in 1282 bytes} [Wed May 11 07:33:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:36:20.382560 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-b1f2ee6b-ec83-4216-ade1-c86fff395172 admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:36:20.383635 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-b1f2ee6b-ec83-4216-ade1-c86fff395172 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 11 07:36:20.384033 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1074 bytes} [Wed May 11 07:36:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:36:20.647793 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-a45779c8-7240-4f03-b36e-7ce0972d757b admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:36:20.648991 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 07:36:20.648991 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: warnings.warn(msg) May 11 07:36:20.650204 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-a45779c8-7240-4f03-b36e-7ce0972d757b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:36:20.650644 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-a45779c8-7240-4f03-b36e-7ce0972d757b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:36:20.651427 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-a45779c8-7240-4f03-b36e-7ce0972d757b admin admin] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:36:20.651855 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-a45779c8-7240-4f03-b36e-7ce0972d757b admin admin] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:36:20.685034 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-a45779c8-7240-4f03-b36e-7ce0972d757b admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.145768 May 11 07:36:20.685619 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 35/70] 10.222.0.36 () {60 vars in 1193 bytes} [Wed May 11 07:36:20 2022] GET /compute/v2.1/os-services => generated 794 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:36:21.589051 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-b1f2ee6b-ec83-4216-ade1-c86fff395172 admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:36:21.590079 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-b1f2ee6b-ec83-4216-ade1-c86fff395172 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 11 07:36:21.590478 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1074 bytes} [Wed May 11 07:36:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:36:21.779851 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-7d720f16-5dcf-4595-bf9b-ba17f9485bf1 admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:36:21.781024 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 07:36:21.781024 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: warnings.warn(msg) May 11 07:36:21.782278 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-7d720f16-5dcf-4595-bf9b-ba17f9485bf1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:36:21.782714 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-7d720f16-5dcf-4595-bf9b-ba17f9485bf1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:36:21.783494 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-7d720f16-5dcf-4595-bf9b-ba17f9485bf1 admin admin] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:36:21.783917 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-7d720f16-5dcf-4595-bf9b-ba17f9485bf1 admin admin] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:36:21.803045 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-7d720f16-5dcf-4595-bf9b-ba17f9485bf1 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.073923 May 11 07:36:21.803578 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 36/72] 10.222.0.36 () {60 vars in 1193 bytes} [Wed May 11 07:36:21 2022] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:36:33.117389 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-b1f2ee6b-ec83-4216-ade1-c86fff395172 admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:36:33.118419 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-b1f2ee6b-ec83-4216-ade1-c86fff395172 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 11 07:36:33.118818 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1074 bytes} [Wed May 11 07:36:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:36:33.306149 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-f3c626fb-4119-4129-88e8-664e96e1daff admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:36:33.307315 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 07:36:33.307315 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: warnings.warn(msg) May 11 07:36:33.308471 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-f3c626fb-4119-4129-88e8-664e96e1daff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:36:33.308900 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-f3c626fb-4119-4129-88e8-664e96e1daff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:36:33.309697 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-f3c626fb-4119-4129-88e8-664e96e1daff admin admin] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:36:33.310168 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-f3c626fb-4119-4129-88e8-664e96e1daff admin admin] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:36:33.335317 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-f3c626fb-4119-4129-88e8-664e96e1daff admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080003 May 11 07:36:33.335791 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 37/74] 10.222.0.36 () {60 vars in 1193 bytes} [Wed May 11 07:36:33 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:36:34.244306 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: DEBUG nova.api.openstack.wsgi [None req-b1f2ee6b-ec83-4216-ade1-c86fff395172 admin admin] Calling method '>' {{(pid=102828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:36:34.245304 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: INFO nova.api.openstack.requestlog [None req-b1f2ee6b-ec83-4216-ade1-c86fff395172 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 11 07:36:34.245819 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: [pid: 102828|app: 0|req: 38/75] 10.222.0.36 () {56 vars in 1074 bytes} [Wed May 11 07:36:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:36:34.433136 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG nova.api.openstack.wsgi [None req-79fce38c-4074-4d54-9e36-9fa432830dde admin admin] Calling method '>' {{(pid=102827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:36:34.434348 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 07:36:34.434348 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: warnings.warn(msg) May 11 07:36:34.435505 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-79fce38c-4074-4d54-9e36-9fa432830dde admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:36:34.435937 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-79fce38c-4074-4d54-9e36-9fa432830dde admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:36:34.436705 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-79fce38c-4074-4d54-9e36-9fa432830dde admin admin] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:36:34.437156 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: DEBUG oslo_concurrency.lockutils [None req-79fce38c-4074-4d54-9e36-9fa432830dde admin admin] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:36:34.457992 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: INFO nova.api.openstack.requestlog [None req-79fce38c-4074-4d54-9e36-9fa432830dde admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.074503 May 11 07:36:34.458456 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: [pid: 102827|app: 0|req: 38/76] 10.222.0.36 () {60 vars in 1193 bytes} [Wed May 11 07:36:34 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:37:33.073483 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: Wed May 11 07:37:33 2022 - graceful shutdown triggered... May 11 07:37:33.073648 dv-cinder-836996-20-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 11 07:37:33.074641 dv-cinder-836996-20-iscsi devstack@n-api.service[102828]: Gracefully killing worker 2 (pid: 102828)... May 11 07:37:33.075077 dv-cinder-836996-20-iscsi devstack@n-api.service[102827]: Gracefully killing worker 1 (pid: 102827)... May 11 07:37:34.075704 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: worker 1 buried after 1 seconds May 11 07:37:34.075704 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: worker 2 buried after 1 seconds May 11 07:37:34.076313 dv-cinder-836996-20-iscsi devstack@n-api.service[102826]: goodbye to uWSGI. May 11 07:37:34.077299 dv-cinder-836996-20-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 11 07:37:34.077895 dv-cinder-836996-20-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 11 07:37:34.080586 dv-cinder-836996-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 11 07:37:34.095802 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 11 07:37:34.111097 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 07:37:34 2022] *** May 11 07:37:34.111097 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 07:37:34.111097 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 07:37:34.111097 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: nodename: dv-cinder-836996-20-iscsi May 11 07:37:34.111097 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: machine: x86_64 May 11 07:37:34.111097 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: clock source: unix May 11 07:37:34.111097 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: pcre jit disabled May 11 07:37:34.111097 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: detected number of CPU cores: 4 May 11 07:37:34.111097 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: current working directory: / May 11 07:37:34.111097 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: detected binary path: /usr/bin/uwsgi-core May 11 07:37:34.111850 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: your processes number limit is 47680 May 11 07:37:34.111850 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: your memory page size is 4096 bytes May 11 07:37:34.111850 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: detected max file descriptor number: 2048 May 11 07:37:34.111850 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: lock engine: pthread robust mutexes May 11 07:37:34.111850 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: thunder lock: enabled May 11 07:37:34.111850 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 11 07:37:34.111850 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 07:37:34.157158 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: Python main interpreter initialized at 0x562f50ed89c0 May 11 07:37:34.157158 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: python threads support enabled May 11 07:37:34.157158 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: your server socket listen backlog is limited to 100 connections May 11 07:37:34.157158 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: your mercy for graceful operations on workers is 90 seconds May 11 07:37:34.157629 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: mapped 403077 bytes (393 KB) for 2 cores May 11 07:37:34.157629 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: *** Operational MODE: preforking *** May 11 07:37:34.157886 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: *** uWSGI is running in multiple interpreter mode *** May 11 07:37:34.157886 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: spawned uWSGI master process (pid: 123586) May 11 07:37:34.158092 dv-cinder-836996-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 11 07:37:34.159242 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: spawned uWSGI worker 1 (pid: 123599, cores: 1) May 11 07:37:34.159242 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: spawned uWSGI worker 2 (pid: 123600, cores: 1) May 11 07:37:34.159242 dv-cinder-836996-20-iscsi devstack@n-api.service[123586]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 07:37:35.357040 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 07:37:35.384388 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 07:37:36.155945 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 07:37:36.155945 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: from cryptography.utils import int_from_bytes May 11 07:37:36.156266 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 07:37:36.156266 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: from cryptography.utils import int_from_bytes May 11 07:37:36.187852 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 07:37:36.187852 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: from cryptography.utils import int_from_bytes May 11 07:37:36.188172 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 07:37:36.188172 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: from cryptography.utils import int_from_bytes May 11 07:37:38.591963 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 07:37:38.592507 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 07:37:38.592806 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 07:37:38.593721 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 07:37:38.593982 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 07:37:38.594374 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.594736 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.595020 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.595338 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.595669 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.595980 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.596302 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.596622 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.596952 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.597216 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.597531 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.597898 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-20-iscsi {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.598204 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.598513 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.598826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.599147 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.599455 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.599781 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.600088 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.600597 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.601995 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.601995 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.601995 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.601995 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.602309 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.602606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.602927 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.603240 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.603566 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.603878 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.604288 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-20-iscsi {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.604599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.604911 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.605226 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.605666 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.605980 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.606290 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.606612 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.606935 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.607243 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.607569 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.607889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.608209 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.608575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.608880 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.609188 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.609502 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.609848 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.610156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.610464 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.610723 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.611033 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.611357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.611681 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.612006 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.612262 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.612515 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.612836 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.613156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.613465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.613803 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.614114 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.614422 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.614732 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.615039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.615346 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.615653 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.615975 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.616291 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.616614 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.616923 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.617246 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.617666 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.617922 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.618231 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.618570 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.618891 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.619199 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.619519 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.619840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.620145 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.620451 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.620763 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.621085 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.621411 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.621742 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.621997 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.622298 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.622605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.622925 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.623231 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.623537 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.623843 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.624655 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.625037 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.625268 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.625594 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.625904 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.626212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.626517 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.626823 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.627130 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.627437 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.627757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.628077 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.628385 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.628691 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.628996 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.629302 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.629668 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.629977 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.630283 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.630605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.630912 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.631223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.631541 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.631850 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.632156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.632475 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.632776 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.633084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.633399 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.633741 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.634047 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.634353 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.634657 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.634963 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.635266 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.635568 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.635873 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.636173 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.636491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.636812 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.637120 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.637427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.637757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.638078 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.638416 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.638749 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.639090 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.639404 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.640294 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.640626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.640947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.641265 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.641605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.641933 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.642246 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.642555 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.642866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.643184 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.643500 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.643828 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.644144 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.644458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.644778 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.645118 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.645402 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.645755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.646079 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.646389 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.646728 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.647068 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.647381 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.647707 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.648026 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.648339 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.648652 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.648964 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.649284 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.649645 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.649959 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.650276 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.650588 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.650901 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.651218 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.651530 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.651842 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.652178 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.652492 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.652809 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.653120 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.653436 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.653774 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.654089 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.654402 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.654708 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.655014 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.655345 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.655656 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.655959 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.656280 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.656607 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.656912 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.657245 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.657566 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.657887 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.658200 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.658511 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.658816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.659126 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.659437 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.659745 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.660064 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.660373 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.660679 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.661000 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.661310 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.661647 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.661963 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.662273 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.662584 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.662895 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.663204 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.663526 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.663837 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.664149 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.664483 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.664815 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.665120 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.665448 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.665795 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.666114 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.666418 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.666728 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.667034 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.667339 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.667644 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.667953 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.668256 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.668560 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.668862 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.669167 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.669471 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.669867 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.670126 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.670431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.670734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.671071 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.671417 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.671725 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.672070 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.672408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.672728 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.673052 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.673366 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.673706 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.674020 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.674332 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.674644 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.674937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 07:37:38.675434 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.675651 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 07:37:38.675797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.675797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.676066 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 07:37:38.676221 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.676373 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 07:37:38.676517 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.676666 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 07:37:38.676823 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.676966 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.677116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.677266 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.677416 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.677589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.677751 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.677895 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.678050 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.678192 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.678344 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.678496 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.678648 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.678806 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.678948 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.679089 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.679228 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.679375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.679523 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.679679 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.679832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.679992 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.680136 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.680304 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-20-iscsi {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.680454 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.680605 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.680748 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.680896 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.681038 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.681178 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.681332 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.681481 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.681672 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.681826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.681975 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.682125 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.682285 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.682434 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.682581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.682581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.682857 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.683035 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.683192 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.683338 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.683488 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.683630 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.683781 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.683950 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.684110 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.684270 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.684413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.684553 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.684695 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.684843 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.684998 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.685147 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.685289 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.685438 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.685624 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.685792 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.685945 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.686088 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.686229 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.686368 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-20-iscsi {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.686999 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.687154 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.687296 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.687444 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.687586 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.687726 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.687899 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.688063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.688226 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.688368 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.688517 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.688667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.688818 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.688968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.689118 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.689455 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.689639 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.689796 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.689950 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.690100 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.690253 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.690407 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.690557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.690707 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.690864 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.691268 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.691411 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.691552 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.691693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.691834 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.691984 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.692137 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.692287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.692437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.692579 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.692735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.692884 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.693026 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.693186 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.693186 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.693460 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.693665 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.693812 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.693960 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.694109 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.694259 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.694411 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.694563 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.694718 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.694868 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.695011 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.695152 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.695372 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.695531 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.695674 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.695816 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.695957 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.696098 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.696257 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.696408 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.696558 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.696707 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.696848 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.696989 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.697142 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.697291 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.697432 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.697606 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.697755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.697905 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.698056 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.698197 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.698345 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.698486 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.698635 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.698786 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.698929 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.699076 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.699217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.699366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.699513 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.699669 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.699811 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.699811 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.700098 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.700098 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.700374 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.700525 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.700676 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.700825 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.700967 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.701116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.701305 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.701455 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.701651 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.701810 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.701970 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.702154 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.702834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.702993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.703145 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.703297 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.703462 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.703609 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.703787 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.703936 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.704114 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.704269 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.704422 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.704572 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.704714 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.704854 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.705006 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.705161 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.705303 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.705443 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.705631 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.705789 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.705941 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.706119 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.706276 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.706441 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.706592 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.706733 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.706881 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.707032 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.707182 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.707321 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.707461 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.707610 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.707751 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.707904 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.708047 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.708196 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.708354 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.708496 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.708645 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.708795 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.708944 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.709093 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.709847 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.710002 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.710164 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.710307 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.710456 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.710607 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.710757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.710913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.711069 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.711221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.711363 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.711503 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.711643 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.711791 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.711943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.712093 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.712243 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.712395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.712544 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.712685 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.712685 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.712972 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.712972 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.713267 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.713413 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.713572 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.713731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.713881 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.714033 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.714175 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.714325 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.714466 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.714625 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.714768 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.714923 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.715065 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.715205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.715347 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.715500 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.715650 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.715805 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.715949 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.716089 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.716238 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.716387 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.716538 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.716695 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.716845 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.716988 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.717136 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.717277 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.717433 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.717611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.717760 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.717902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.718053 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.718196 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.718350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.718504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.718645 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.718792 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.718934 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.719084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.719238 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.719381 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.719522 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.719670 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.719812 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.719954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.720103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.720245 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.720409 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:37:38.720553 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.720695 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.720850 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.720993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.721152 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.721332 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.721486 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.721653 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.721809 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.721809 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.722086 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.722247 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.722398 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.722545 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.722770 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.722922 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.723072 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.723220 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.723365 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.723517 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.723666 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.723816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.723959 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.724099 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.724250 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.724401 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.724555 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.724703 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.724846 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.724993 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.725142 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.725293 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.725454 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.725655 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.725804 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.725954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.726103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.726269 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.726413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.726554 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.726696 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.726837 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.726993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.727142 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.727284 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.727425 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.727574 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.727723 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.727723 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.728025 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.728168 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.728317 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.728467 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.728608 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.728759 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.728901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.729044 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.729192 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.729342 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.729483 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.729664 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.729809 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.729968 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.730118 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.730260 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.730420 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.730562 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.730703 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.730844 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.730984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.731126 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.731276 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.731429 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.731572 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.731720 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.731870 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.732012 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.732167 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.732310 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.732451 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.732592 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.732733 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.732872 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.733023 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.733181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.733325 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.733467 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.733638 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.733803 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.733945 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.734094 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.734237 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.734385 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.734533 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.734688 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.734829 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.735021 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.735172 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.735325 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.735475 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.735625 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.735788 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.735930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.736071 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.736212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.736361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.736512 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.736667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.736808 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.736956 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.737097 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.737237 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.737388 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.737593 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.737752 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.737903 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.738044 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.738198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.738348 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.738491 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.738631 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.738772 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.738958 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.739113 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.739255 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.739403 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.739564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.739706 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.739848 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.739999 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.740141 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.740297 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.740440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.740582 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.740730 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.740885 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.741029 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.741178 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.741327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.741479 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.741663 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.741814 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.741957 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.742098 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.742239 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.742388 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.742549 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.742549 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.742827 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.742827 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.743109 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.743270 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.743427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.743576 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.743726 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.743868 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.744018 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.744158 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.744310 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.744457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.744606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.744757 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.744898 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.745052 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.745202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.745361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.745516 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.745696 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.745840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.746032 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.746177 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.746318 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.746459 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.746600 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.746752 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.746909 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.747060 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.747212 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.747354 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.747502 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.747654 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.747804 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.747963 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.748119 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.748285 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.748435 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.748597 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.748746 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.748903 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.749560 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.749727 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.749877 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.750040 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.750191 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.750339 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.750487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.750643 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.750792 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.750949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.751099 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.751248 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.751404 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.751563 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.751722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.751871 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.752020 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.752167 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.752314 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.752463 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.752626 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.752783 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.752932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.753080 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.753245 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.753402 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.753712 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.753871 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.754028 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.754185 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.754341 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.754498 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.754661 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.754810 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.754965 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.755114 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.755263 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.755420 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.755576 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.755735 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.755892 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.756094 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.756258 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.756422 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.756579 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.756730 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.756885 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.757044 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.757193 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.757390 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.757565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.757721 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.757884 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.758033 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.758181 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.758347 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.758497 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.758646 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.758794 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.758951 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.759111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.759261 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.759409 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.759557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.759715 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.759863 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.760021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.760171 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.760319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.760467 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.760629 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.760778 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.761007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.761157 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.761306 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.761462 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.761638 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.761800 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.761961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.762119 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.762275 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.762432 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.762589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.762751 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.762901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.763049 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.763207 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.763364 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.763523 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.763683 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.763849 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.763999 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.764146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.764294 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.764449 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.764613 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.765344 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.765496 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.765702 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.765853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.766001 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.766162 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.766324 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.766448 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.766553 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.766653 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.766743 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.766835 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.766923 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.767015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.767101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.767194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.767295 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.767382 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.767480 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.767572 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.767665 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.767759 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.767855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.767948 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.768071 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.768243 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.768394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.768551 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.768715 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.768866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.769014 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.769163 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.769329 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.769498 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.769696 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.769863 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.770012 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.770161 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.770308 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.770470 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.770620 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.770767 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.770916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.771064 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.771211 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.771384 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.771541 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.771699 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.771847 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.772005 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.772154 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.772315 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.772465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.772613 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.772761 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.772916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.773064 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.773221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.773386 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.773573 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.773730 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.773880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.774056 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.774213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.774369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.774518 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.774666 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.774822 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.774984 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.775135 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.775283 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.775440 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.775629 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.775778 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.775935 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.776085 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.776242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.776398 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.776578 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.776733 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.776921 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.777080 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.777237 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.777397 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.777580 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.777789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.777949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.778097 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.778246 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.778395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.778550 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.778714 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.778864 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.779020 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.779169 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.779318 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.779477 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.779635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.779784 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.779932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.780087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.780259 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.780421 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.780580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.780580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.780871 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.781028 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.781177 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.781335 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.781502 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.781502 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.781853 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.782010 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.782165 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.782323 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.782473 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.782621 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.782768 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.782916 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.783071 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.783233 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.783408 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.783566 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.783723 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.783872 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.784040 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.784196 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.784344 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.784491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.784653 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.784802 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.784958 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.785106 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.785254 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.785418 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.785609 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.785773 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.785928 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.786076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.786233 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.786391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.786548 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.786697 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.786849 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.787005 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.787161 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.787328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.787486 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.787634 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.787782 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.787930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.788077 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.788307 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.788466 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.788614 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.788764 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.788928 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.789086 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.789245 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.789394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.789577 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.789734 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.789893 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.790057 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.790214 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.790363 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.790511 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.790666 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.790816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.790973 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.791129 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.791289 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.791437 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.791586 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.791748 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.791897 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.792046 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.792201 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.792350 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.792498 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.792655 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.792810 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.792961 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.793119 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.793284 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.793433 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.793704 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.793877 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.794040 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.794205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.794367 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.794517 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.794666 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.794824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.794973 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.795133 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.795301 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.795458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.795615 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.795772 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.795949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.796100 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.796258 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.796407 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.796555 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.796703 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.796859 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.797026 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.797186 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.797346 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.797502 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.797688 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.797846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.798004 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.798154 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.798310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.798458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.798613 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.798613 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.798905 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.799055 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.799204 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.799370 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.799526 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.799675 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.799832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.799991 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.800141 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.800298 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.800454 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.800612 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.800768 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.800924 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.801081 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.801240 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.801390 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.801581 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.801748 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.801898 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.802047 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.802206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.802356 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.802519 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.802677 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.802833 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.802990 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.803140 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.803306 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.803467 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.803623 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.803772 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.803926 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.804078 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.804240 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.804389 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.804537 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.804693 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.804842 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.804990 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.805153 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.805312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.805468 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.805644 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.805806 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.805962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.806121 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.806277 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.806427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.806584 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.806733 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.806889 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.807048 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.807206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.807373 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.807523 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.807672 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.807832 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.807981 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.808129 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.808277 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.808432 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.808580 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.808739 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.808888 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.809043 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.809191 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.809359 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.809516 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.809798 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.809951 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.810107 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.810257 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.810420 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.810577 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.810736 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.810887 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.811042 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.811191 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.811358 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.812041 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.812201 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.812350 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.812499 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.812653 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.812815 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.812974 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.813124 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.813280 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.813429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.813609 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.813765 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.813934 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.814085 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.814085 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.814384 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.814538 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.814695 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.814854 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.815004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.815153 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.815300 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.815455 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.815612 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.815767 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.816202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.816372 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.816530 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.816686 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.816849 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.817006 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.817163 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.817321 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.817478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.817697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.817860 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.818018 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.818185 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.818335 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.818482 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.818631 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.818789 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.818938 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.819086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.819086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.819384 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.819542 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.819691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.819847 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.819996 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.820154 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.820305 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.820461 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.820609 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.820769 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.820918 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.820918 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.821214 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.821372 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.821530 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.821710 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.821858 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.822005 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.822175 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.822336 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.822495 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.822653 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.822809 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.822972 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.823135 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.823135 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.823427 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.823584 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.823740 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.823896 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.824064 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.824212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.824419 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.824574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.824731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.824887 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.825049 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.825049 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.825346 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.825346 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.825669 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.825832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.825989 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.826148 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.826304 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.826452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.826601 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.826759 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.826908 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.826908 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.827733 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.827733 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.828030 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.828193 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.828342 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.828342 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.828642 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.828642 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.828946 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.829106 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.829256 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.829405 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.829585 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.829742 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.829904 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.830054 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.830210 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.830359 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.830518 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.830668 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.830830 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.830987 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.831137 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.831284 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.831432 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.831588 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.831747 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.831904 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.832060 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.832217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.832375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.832534 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.832682 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.832831 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.832987 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.833142 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.833290 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.833447 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.833617 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.833782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.833939 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.834089 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.834089 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.834400 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.834561 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.834718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.834874 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.835022 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.835170 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.835328 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.835478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.835634 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.835782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.835931 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.836088 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.836244 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.836402 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.836551 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.836698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.836853 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.837011 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.837168 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.837324 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.837473 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.837661 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.837820 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.837979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.838137 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.838294 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.838467 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.838623 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.838779 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.838975 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.839131 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.839279 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.839427 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.839581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.839810 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.839968 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.839968 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.840261 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.840421 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.840570 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.840726 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.840875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.841023 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.841173 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.841320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.841468 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.841674 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.841780 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.841871 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.841977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.842067 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.842161 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.842262 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.842358 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.842445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.842555 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.842654 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.842787 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.842873 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.842959 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.843059 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.843145 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.843229 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.843325 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.843411 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.843490 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.843581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.843676 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.843770 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.843870 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.843950 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.844035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.844127 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.844219 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.844313 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.844398 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.844490 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.844576 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.844659 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.844800 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.844984 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.845145 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.845313 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.845464 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.845659 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.845825 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.845990 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.846140 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.846288 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.846448 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.846598 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.846754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.846913 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.847071 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.847229 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.847385 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.847536 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.847694 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.847843 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.847991 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.848138 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.848297 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.848446 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.848610 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.848767 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.848916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.849071 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.849220 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.849376 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.849563 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.849739 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.849890 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.850038 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123599) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 07:37:38.850194 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.850399 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.850707 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.851015 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.851330 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.851641 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.851949 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.852258 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.852571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.852878 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.853191 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.853498 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.853849 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.854158 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.854484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.854798 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.855111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.855420 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.855728 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.856077 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.856385 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.856721 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.857043 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.857369 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.857734 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.858056 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.858410 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.858732 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.859053 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.859374 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.859691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.860012 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.860330 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.860649 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.860963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.861283 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.861624 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.861946 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.862476 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.862814 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.863143 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.863463 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.863782 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.864100 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.864421 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.864740 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.865058 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.865375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.865717 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.866052 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.866378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.866710 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.867049 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.867399 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.868274 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.868454 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.868674 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.869045 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.869370 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.869709 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.870028 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.870353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.870675 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.870992 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.871310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.871631 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.871947 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.872266 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.872581 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.872824 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_db.sqlalchemy.engines [None req-ef849132-64e0-4939-a2aa-09c09f0a0afa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:37:38.872938 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.873208 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.873585 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.873905 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.874761 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.875087 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.875405 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.875727 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.876276 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.876601 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.876944 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.877278 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.877634 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.877961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.878286 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.878630 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.878937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.879249 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.879573 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.879891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.880201 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.880533 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.880850 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.881165 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.881490 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.881831 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.882369 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.882719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.883042 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.883372 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.883708 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.884030 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.884340 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.884669 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.884980 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.885291 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.885636 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.885954 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.886264 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.886574 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.886891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.887211 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.887522 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.887836 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.888145 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.888476 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.888787 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.889095 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.889404 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.890275 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.890593 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.890902 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.891208 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.891517 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.891837 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.892139 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.892450 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.892757 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.893071 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.893379 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.893723 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.894093 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.894423 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.894733 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.895042 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.895362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.895680 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.896005 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.896321 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.896636 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.896988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.897308 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.897875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.898213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.898539 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.898879 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.899216 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.899529 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.899843 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.900151 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.900480 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.900795 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.901114 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.901429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.901768 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.902086 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.902404 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.902718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.903034 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.903349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.903672 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.903988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.904302 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.904622 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.904969 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.905346 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.905701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.906029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.906352 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.906670 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.906988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.907307 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.907622 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.907945 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.908281 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.908601 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.908910 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.909339 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.909677 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.910008 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.910334 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.910649 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.910977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.911305 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.911621 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.911945 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.912263 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.912598 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.912942 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.913276 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.913641 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.913957 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.914268 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.914579 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.914895 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.915219 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.915533 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.915842 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.916153 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.916463 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.916775 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.917084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.917393 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.917726 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.918042 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.918349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.918656 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.918962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.919270 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.919576 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.919882 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.920198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.920502 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.920823 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.921142 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.921452 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.921783 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.922122 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.922463 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.922783 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.923113 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.923429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.923762 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.924079 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.924407 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.924737 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.925055 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.925370 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.925734 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.926058 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.926373 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.926688 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.927004 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.927323 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.927639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.927972 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.928304 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.928792 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.928949 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.929269 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.929622 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.929948 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.930270 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.930604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.930921 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.931239 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.931563 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.931879 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.932198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.932523 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.932850 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.933185 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.933525 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.933877 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.934211 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.934566 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.934885 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.935236 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.935573 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.935894 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.936212 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.937035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:37:38.937149 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.context [None req-ef849132-64e0-4939-a2aa-09c09f0a0afa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c793e13-41c1-4464-88e9-f3c40625395f(cell1) {{(pid=123599) load_cells /opt/stack/nova/nova/context.py:464}} May 11 07:37:38.937290 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 07:37:38.941787 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef849132-64e0-4939-a2aa-09c09f0a0afa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:37:38.943347 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef849132-64e0-4939-a2aa-09c09f0a0afa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:37:38.944153 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef849132-64e0-4939-a2aa-09c09f0a0afa None None] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:37:38.946086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef849132-64e0-4939-a2aa-09c09f0a0afa None None] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:37:38.958085 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_db.sqlalchemy.engines [None req-ef849132-64e0-4939-a2aa-09c09f0a0afa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:37:38.960948 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_db.sqlalchemy.engines [None req-ef849132-64e0-4939-a2aa-09c09f0a0afa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:37:38.962336 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_db.sqlalchemy.engines [None req-384b698c-2f9f-4201-bd7a-0c03de5be203 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:37:39.026755 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.context [None req-384b698c-2f9f-4201-bd7a-0c03de5be203 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6c793e13-41c1-4464-88e9-f3c40625395f(cell1) {{(pid=123600) load_cells /opt/stack/nova/nova/context.py:464}} May 11 07:37:39.031133 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-384b698c-2f9f-4201-bd7a-0c03de5be203 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:37:39.032740 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-384b698c-2f9f-4201-bd7a-0c03de5be203 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:37:39.033594 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-384b698c-2f9f-4201-bd7a-0c03de5be203 None None] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:37:39.035550 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-384b698c-2f9f-4201-bd7a-0c03de5be203 None None] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:37:39.049890 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_db.sqlalchemy.engines [None req-384b698c-2f9f-4201-bd7a-0c03de5be203 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:37:39.051299 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_db.sqlalchemy.engines [None req-384b698c-2f9f-4201-bd7a-0c03de5be203 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:37:39.119071 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_db.sqlalchemy.engines [None req-ef849132-64e0-4939-a2aa-09c09f0a0afa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123599) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:37:39.209330 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_db.sqlalchemy.engines [None req-384b698c-2f9f-4201-bd7a-0c03de5be203 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:37:39.448889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: WARNING keystonemiddleware.auth_token [None req-ef849132-64e0-4939-a2aa-09c09f0a0afa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 07:37:39.456717 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: WARNING keystonemiddleware.auth_token [None req-ef849132-64e0-4939-a2aa-09c09f0a0afa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 07:37:39.531249 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: WARNING keystonemiddleware.auth_token [None req-384b698c-2f9f-4201-bd7a-0c03de5be203 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 07:37:39.539681 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: WARNING keystonemiddleware.auth_token [None req-384b698c-2f9f-4201-bd7a-0c03de5be203 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 07:37:39.808827 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: WARNING keystonemiddleware.auth_token [None req-ef849132-64e0-4939-a2aa-09c09f0a0afa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 07:37:39.817167 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: WARNING keystonemiddleware.auth_token [None req-ef849132-64e0-4939-a2aa-09c09f0a0afa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 07:37:39.823007 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562f50ed89c0 pid: 123599 (default app) May 11 07:37:39.889324 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: WARNING keystonemiddleware.auth_token [None req-384b698c-2f9f-4201-bd7a-0c03de5be203 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 07:37:39.896026 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: WARNING keystonemiddleware.auth_token [None req-384b698c-2f9f-4201-bd7a-0c03de5be203 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 07:37:39.901332 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562f50ed89c0 pid: 123600 (default app) May 11 07:38:22.480144 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-55e8b8fb-2e64-40df-aab6-3f5680091f27 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Action: 'create', calling method: .version_select at 0x7f19ee9e7280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-901390993"}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:38:22.884272 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-436eaa67-1919-4d18-81d1-a830ff61a485 tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] Calling method '.version_select at 0x7f19eea2b160>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:24.226226 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-436eaa67-1919-4d18-81d1-a830ff61a485 tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/fdc3ce7e-7d66-47f2-bde5-171c0bb38b42" status: 200 len: 350 microversion: 2.1 time: 1.721792 May 11 07:38:24.227957 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 1/1] 10.222.0.36 () {58 vars in 1244 bytes} [Wed May 11 07:38:22 2022] GET /compute/v2.1/os-volumes/fdc3ce7e-7d66-47f2-bde5-171c0bb38b42 => generated 350 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:38:24.372567 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-525313487", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "networks": [{"uuid": "18b5bf80-b800-45f7-8cd6-6c95a35d27fb"}]}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:38:24.375168 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-55e8b8fb-2e64-40df-aab6-3f5680091f27 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.450116 May 11 07:38:24.376142 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 1/2] 10.222.0.36 () {60 vars in 1154 bytes} [Wed May 11 07:38:20 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3453 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 11 07:38:24.389562 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-45e18821-076c-4d3c-91f2-9270f5d0d9f6 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19ee841280>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:24.650833 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.network.neutron [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] validate_networks() for [('18b5bf80-b800-45f7-8cd6-6c95a35d27fb', None, None, None, None, None)] {{(pid=123600) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:38:24.671279 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-45e18821-076c-4d3c-91f2-9270f5d0d9f6 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa" status: 200 len: 345 microversion: 2.1 time: 0.286579 May 11 07:38:24.673247 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1244 bytes} [Wed May 11 07:38:24 2022] GET /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa => generated 345 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:38:24.685753 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c71e4e2f-beba-41b7-be86-30bb71c0ac01 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Action: 'create', calling method: .version_select at 0x7f19ee8414c0>, body: {"snapshot": {"volume_id": "77fe36c7-e6aa-4621-aaf9-13a32aca95aa", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-8517426"}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:38:25.258308 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c71e4e2f-beba-41b7-be86-30bb71c0ac01 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 284 microversion: 2.1 time: 0.577013 May 11 07:38:25.259163 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 3/4] 10.222.0.36 () {60 vars in 1161 bytes} [Wed May 11 07:38:24 2022] POST /compute/v2.1/os-snapshots => generated 284 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:25.269890 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-76da6329-97bb-4fe7-8ab5-65f799baa190 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19ee841ee0>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:25.415651 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-76da6329-97bb-4fe7-8ab5-65f799baa190 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589" status: 200 len: 284 microversion: 2.1 time: 0.150033 May 11 07:38:25.421442 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 4/5] 10.222.0.36 () {58 vars in 1250 bytes} [Wed May 11 07:38:25 2022] GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589 => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:38:25.426098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a553a65d-83ee-4e8a-87d2-ab10a45ed3be tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] Calling method '.version_select at 0x7f19ee848670>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:25.519721 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a553a65d-83ee-4e8a-87d2-ab10a45ed3be tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/66267ba0-089e-4a20-80b6-ab908ca28d0e" status: 200 len: 351 microversion: 2.1 time: 0.097130 May 11 07:38:25.520823 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 5/6] 10.222.0.36 () {58 vars in 1244 bytes} [Wed May 11 07:38:25 2022] GET /compute/v2.1/os-volumes/66267ba0-089e-4a20-80b6-ab908ca28d0e => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:25.527288 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-280835f3-7b93-4bcf-884d-513bfd026881 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19ee841dc0>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:25.740661 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-280835f3-7b93-4bcf-884d-513bfd026881 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.217543 May 11 07:38:25.741237 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 6/7] 10.222.0.36 () {58 vars in 1139 bytes} [Wed May 11 07:38:25 2022] GET /compute/v2.1/os-snapshots => generated 287 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:25.752152 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-433767b3-4fb2-4acf-8b4e-33743745e6eb tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19ee848a60>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:25.816996 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-433767b3-4fb2-4acf-8b4e-33743745e6eb tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589" status: 200 len: 284 microversion: 2.1 time: 0.069275 May 11 07:38:25.818404 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 7/8] 10.222.0.36 () {58 vars in 1250 bytes} [Wed May 11 07:38:25 2022] GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589 => generated 284 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:38:26.841561 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7b25a261-116d-41c0-9f4e-6eb3be16d95b tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19ee848280>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:26.969746 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-7b25a261-116d-41c0-9f4e-6eb3be16d95b tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589" status: 200 len: 284 microversion: 2.1 time: 0.141761 May 11 07:38:26.970794 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 8/9] 10.222.0.36 () {58 vars in 1250 bytes} [Wed May 11 07:38:26 2022] GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589 => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:27.465662 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Flavor limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:38:27.466133 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Image limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:38:27.466553 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Flavor pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:38:27.466957 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Image pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:38:27.467711 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:38:27.499810 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:27.500664 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:27.503911 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:27.504314 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:27.602023 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Getting quotas for project 96ac52de89f14d7995335a0d2c06ed8c. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:38:27.611677 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Getting quotas for user 3d8e948ae270457a8a9b6197f6a02394 and project 96ac52de89f14d7995335a0d2c06ed8c. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:38:27.643006 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Going to run 1 instances... {{(pid=123600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:38:27.647568 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:38:27.823264 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d84dca9d-4040-4d43-8d24-d3b649e811d2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.592777 May 11 07:38:27.824022 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 2/10] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:38:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:38:27.841766 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-aa34826d-27ab-4d44-8f21-d25b1904e2c3 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:27.843989 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-aa34826d-27ab-4d44-8f21-d25b1904e2c3 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:27.983933 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f9feef22-bfb2-4da5-bd94-a5f19b9ccd2c tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19ee8f3700>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:28.048060 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f9feef22-bfb2-4da5-bd94-a5f19b9ccd2c tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589" status: 200 len: 284 microversion: 2.1 time: 0.069763 May 11 07:38:28.052057 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 3/11] 10.222.0.36 () {58 vars in 1250 bytes} [Wed May 11 07:38:27 2022] GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589 => generated 284 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:28.390870 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-aa34826d-27ab-4d44-8f21-d25b1904e2c3 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:28.434686 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-aa34826d-27ab-4d44-8f21-d25b1904e2c3 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1214 microversion: 2.1 time: 0.597570 May 11 07:38:28.436490 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 9/12] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:27 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1214 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:29.059725 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-93b1d66b-3782-4fb6-988d-bc9c324b1083 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19edf4d8b0>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:29.109160 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-93b1d66b-3782-4fb6-988d-bc9c324b1083 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589" status: 200 len: 285 microversion: 2.1 time: 0.053132 May 11 07:38:29.110420 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 4/13] 10.222.0.36 () {58 vars in 1250 bytes} [Wed May 11 07:38:29 2022] GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589 => generated 285 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:29.126404 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0a741e6f-bb84-4089-b032-78b93e28a9dc tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19ee80cf70>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:29.262916 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0a741e6f-bb84-4089-b032-78b93e28a9dc tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589" status: 202 len: 0 microversion: 2.1 time: 0.146391 May 11 07:38:29.263901 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 10/14] 10.222.0.36 () {58 vars in 1253 bytes} [Wed May 11 07:38:29 2022] DELETE /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 07:38:29.273881 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d254b92e-0400-404a-ad8b-b0d3efea7017 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19edf4df70>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:29.340192 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d254b92e-0400-404a-ad8b-b0d3efea7017 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589" status: 200 len: 284 microversion: 2.1 time: 0.072052 May 11 07:38:29.341153 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 5/15] 10.222.0.36 () {58 vars in 1250 bytes} [Wed May 11 07:38:29 2022] GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589 => generated 284 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:29.426489 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-5e0b48b6-103e-41ae-9be7-06b2e15d6b31 tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] Calling method '.version_select at 0x7f19ee81c160>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:29.458812 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2c05af85-8c19-4948-b3ed-25f7c74c16a8 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:29.460126 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2c05af85-8c19-4948-b3ed-25f7c74c16a8 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:29.575068 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-5e0b48b6-103e-41ae-9be7-06b2e15d6b31 tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/a8ad8583-c5b1-4958-ae9a-82c610b16b87" status: 200 len: 351 microversion: 2.1 time: 0.153134 May 11 07:38:29.577613 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 11/16] 10.222.0.36 () {58 vars in 1244 bytes} [Wed May 11 07:38:29 2022] GET /compute/v2.1/os-volumes/a8ad8583-c5b1-4958-ae9a-82c610b16b87 => generated 351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:29.589913 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-056aa757-127a-4a44-b687-c2316e9cb2b7 tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] Calling method '.version_select at 0x7f19ee81c820>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:29.685454 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-2c05af85-8c19-4948-b3ed-25f7c74c16a8 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:29.729362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2c05af85-8c19-4948-b3ed-25f7c74c16a8 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1214 microversion: 2.1 time: 0.277859 May 11 07:38:29.733755 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 6/17] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:29 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1214 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:38:29.874671 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-056aa757-127a-4a44-b687-c2316e9cb2b7 tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.289245 May 11 07:38:29.875249 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 12/18] 10.222.0.36 () {58 vars in 1133 bytes} [Wed May 11 07:38:29 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:38:29.889938 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4bbd05c7-203c-4802-a625-003e195e7e07 tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] Calling method '.version_select at 0x7f19edf67f70>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:30.156349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4bbd05c7-203c-4802-a625-003e195e7e07 tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.270475 May 11 07:38:30.171117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-f5e12098-c882-4aeb-9c0b-59e3862f0be2 tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] Calling method '.version_select at 0x7f19ee81c940>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:30.171798 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 7/19] 10.222.0.36 () {58 vars in 1148 bytes} [Wed May 11 07:38:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:30.358735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ba9dff65-f2da-4831-bd11-d433010c66ac tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19edf67700>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:30.367663 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-f5e12098-c882-4aeb-9c0b-59e3862f0be2 tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.199052 May 11 07:38:30.377275 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 13/20] 10.222.0.36 () {58 vars in 1133 bytes} [Wed May 11 07:38:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:30.388569 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6cdcb078-d308-42e2-a71b-3a669577b58c tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] Calling method '.version_select at 0x7f19ee848d30>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:30.448176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-ba9dff65-f2da-4831-bd11-d433010c66ac tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] HTTP exception thrown: Snapshot 2a2b20b4-598f-4a07-b853-87ff45a78589 could not be found. May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ba9dff65-f2da-4831-bd11-d433010c66ac tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Request method failure captured: May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589 HTTP/1.1 May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2fs1AJv6thWHtMeZbAhGMjIdAWNGG-vV8wD0uuqaBW3--B9TFhopSDcX6OijnEmBdoUqvGDJsw2rWKMJbIyLSoZGb6_kRlejPU2Rz6OYM5-QiuYE_IoNswh7lEW8jg9Qaj8jHhoKpr5VINPd2Zi4NG5xZX8Vp4oPu1hULAyFoH9HM4 May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 1f8cf9d79fdd4e3a8b46fb3022a12a9f May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1001883112 May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:38:30.455913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:38:30.457035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1f8cf9d79fdd4e3a8b46fb3022a12a9f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1f8cf9d79fdd4e3a8b46fb3022a12a9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1f8cf9d79fdd4e3a8b46fb3022a12a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1f8cf9d79fdd4e3a8b46fb3022a12a9f"}]}] May 11 07:38:30.457035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1001883112 May 11 07:38:30.457035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 1f8cf9d79fdd4e3a8b46fb3022a12a9f May 11 07:38:30.457035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1001883112 May 11 07:38:30.457035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-VolumesSnapshotsTestJSON-1001883112-project May 11 07:38:30.457035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:38:30.457035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:38:30.457035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: f45a14e589ba491f90452d8923620358 May 11 07:38:30.457035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1001883112-project May 11 07:38:30.457035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: May 11 07:38:30.457035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Snapshot 2a2b20b4-598f-4a07-b853-87ff45a78589 could not be found. May 11 07:38:30.457035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '2a2b20b4-598f-4a07-b853-87ff45a78589'} May 11 07:38:30.457035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2a2b20b4-598f-4a07-b853-87ff45a78589 could not be found. (HTTP 404) (Request-ID: req-65e5c2b1-e471-4048-a7f0-e19ffcee84b0) May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:38:30.457719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 07:38:30.458571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2a2b20b4-598f-4a07-b853-87ff45a78589 could not be found. May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 11 07:38:30.459437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:38:30.460394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2a2b20b4-598f-4a07-b853-87ff45a78589 could not be found. May 11 07:38:30.460394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:38:30.460394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:38:30.460394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:38:30.460394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:30.460394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:38:30.460394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:38:30.460394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:38:30.460394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:38:30.460394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2a2b20b4-598f-4a07-b853-87ff45a78589 could not be found. May 11 07:38:30.460394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:38:30.462222 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ba9dff65-f2da-4831-bd11-d433010c66ac tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Returning 404 to user: Snapshot 2a2b20b4-598f-4a07-b853-87ff45a78589 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:38:30.463626 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-ba9dff65-f2da-4831-bd11-d433010c66ac tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589" status: 404 len: 111 microversion: 2.1 time: 0.115209 May 11 07:38:30.465815 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 8/21] 10.222.0.36 () {58 vars in 1250 bytes} [Wed May 11 07:38:30 2022] GET /compute/v2.1/os-snapshots/2a2b20b4-598f-4a07-b853-87ff45a78589 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:38:30.487149 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c9da7901-1d8d-43ea-8904-7496f0a56ffa tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19eed9fe50>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:30.578872 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-6cdcb078-d308-42e2-a71b-3a669577b58c tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.199845 May 11 07:38:30.579571 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 14/22] 10.222.0.36 () {58 vars in 1166 bytes} [Wed May 11 07:38:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:30.595503 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-09cbae6e-b4eb-4a8b-9441-48fa875abf3f tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] Calling method '.version_select at 0x7f19ee8233a0>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:30.628423 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c9da7901-1d8d-43ea-8904-7496f0a56ffa tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa" status: 202 len: 0 microversion: 2.1 time: 0.159326 May 11 07:38:30.628994 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 9/23] 10.222.0.36 () {58 vars in 1247 bytes} [Wed May 11 07:38:30 2022] DELETE /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:38:30.646730 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-cd3403fd-80fa-4493-a261-83841f29131d tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19ed6bda60>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:30.789859 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-cd3403fd-80fa-4493-a261-83841f29131d tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa" status: 200 len: 344 microversion: 2.1 time: 0.149231 May 11 07:38:30.790732 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 10/24] 10.222.0.36 () {58 vars in 1244 bytes} [Wed May 11 07:38:30 2022] GET /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa => generated 344 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:38:30.801001 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ccf5d966-529d-4204-b511-ff013797e390 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:30.803259 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-ccf5d966-529d-4204-b511-ff013797e390 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:30.828846 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ccf5d966-529d-4204-b511-ff013797e390 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:30.838503 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ccf5d966-529d-4204-b511-ff013797e390 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:30.841388 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ccf5d966-529d-4204-b511-ff013797e390 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:30.843353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ccf5d966-529d-4204-b511-ff013797e390 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:30.896190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-09cbae6e-b4eb-4a8b-9441-48fa875abf3f tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.306284 May 11 07:38:30.897801 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 15/25] 10.222.0.36 () {58 vars in 1169 bytes} [Wed May 11 07:38:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:30.912674 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-1080a28f-f266-469d-b0b3-6912ba4da68f tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] Calling method '.version_select at 0x7f19ee80cd30>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:31.110073 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-1080a28f-f266-469d-b0b3-6912ba4da68f tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.202897 May 11 07:38:31.110754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 16/26] 10.222.0.36 () {58 vars in 1154 bytes} [Wed May 11 07:38:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:38:31.122496 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-092505c9-e639-45e9-af85-4b6f72363083 tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] Calling method '.version_select at 0x7f19ee81c4c0>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:31.390536 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-092505c9-e639-45e9-af85-4b6f72363083 tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.272501 May 11 07:38:31.398387 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 17/27] 10.222.0.36 () {58 vars in 1187 bytes} [Wed May 11 07:38:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:31.405838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-9629a5e3-0a77-4a64-99b7-870c61373a41 tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] Calling method '.version_select at 0x7f19ee8239d0>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:31.548816 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-ccf5d966-529d-4204-b511-ff013797e390 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:31.581322 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-ccf5d966-529d-4204-b511-ff013797e390 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1218 microversion: 2.1 time: 0.789030 May 11 07:38:31.594647 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 11/28] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:30 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1218 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:31.606948 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-9629a5e3-0a77-4a64-99b7-870c61373a41 tempest-VolumesTestJSON-1396977035 tempest-VolumesTestJSON-1396977035-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.207379 May 11 07:38:31.607540 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 18/29] 10.222.0.36 () {58 vars in 1154 bytes} [Wed May 11 07:38:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:31.806134 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d5593b96-79ca-47d9-8c98-2011df40db5f tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19ed6698b0>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:31.923575 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d5593b96-79ca-47d9-8c98-2011df40db5f tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa" status: 200 len: 344 microversion: 2.1 time: 0.124257 May 11 07:38:31.930339 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 12/30] 10.222.0.36 () {58 vars in 1244 bytes} [Wed May 11 07:38:31 2022] GET /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa => generated 344 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:32.453467 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-dd0f5662-0c57-4e1e-acf5-a0b1e45d5e63 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Action: 'create', calling method: .version_select at 0x7f19ee81c940>, body: {"keypair": {"name": "tempest-keypair-104399395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDs+Ry+DBU8XiLXJ42Y0w65w/7pinij4x4ohmzwTMkI1AFHGdhZQgtePpPqtT5DbMZMn3aaSZJ8lbxQoOCNdMwtOcwBtzvYS/q3UZb72KWFPioHVgYByRCmDdFoaYLdrIQ=="}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:38:32.557909 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-358896242", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:38:32.559811 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-dd0f5662-0c57-4e1e-acf5-a0b1e45d5e63 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Getting quotas for project 075ba180d52b46ad9cd3334520bcfb89. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:38:32.585922 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-dd0f5662-0c57-4e1e-acf5-a0b1e45d5e63 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Getting quotas for user c6bb9dabb1fc46dda1fe1906ab248c57 and project 075ba180d52b46ad9cd3334520bcfb89. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:38:32.706281 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.network.neutron [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] validate_networks() for [('c4d89019-bced-4db2-9253-82870fddaba6', None, None, None, None, None)] {{(pid=123600) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:38:32.724972 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-dd0f5662-0c57-4e1e-acf5-a0b1e45d5e63 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.684062 May 11 07:38:32.736489 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 19/31] 10.222.0.36 () {62 vars in 1199 bytes} [Wed May 11 07:38:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 696 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 11 07:38:32.754615 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6ffa1d98-897b-4d69-ac76-19e05fbf1570 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:32.759240 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-6ffa1d98-897b-4d69-ac76-19e05fbf1570 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:32.780496 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6ffa1d98-897b-4d69-ac76-19e05fbf1570 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:32.782287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6ffa1d98-897b-4d69-ac76-19e05fbf1570 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:32.796711 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6ffa1d98-897b-4d69-ac76-19e05fbf1570 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:32.800029 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6ffa1d98-897b-4d69-ac76-19e05fbf1570 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:33.286386 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-6ffa1d98-897b-4d69-ac76-19e05fbf1570 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:33.345167 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-6ffa1d98-897b-4d69-ac76-19e05fbf1570 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1210 microversion: 2.1 time: 0.606541 May 11 07:38:33.367186 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 20/32] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:32 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1210 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:33.390909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-04afb7d8-f660-4b18-989a-ff7189725745 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19edf16b80>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:33.570479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-04afb7d8-f660-4b18-989a-ff7189725745 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] HTTP exception thrown: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-04afb7d8-f660-4b18-989a-ff7189725745 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Request method failure captured: May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa HTTP/1.1 May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2fs1AJv6thWHtMeZbAhGMjIdAWNGG-vV8wD0uuqaBW3--B9TFhopSDcX6OijnEmBdoUqvGDJsw2rWKMJbIyLSoZGb6_kRlejPU2Rz6OYM5-QiuYE_IoNswh7lEW8jg9Qaj8jHhoKpr5VINPd2Zi4NG5xZX8Vp4oPu1hULAyFoH9HM4 May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 1f8cf9d79fdd4e3a8b46fb3022a12a9f May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1001883112 May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:38:33.574791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:38:33.575979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1f8cf9d79fdd4e3a8b46fb3022a12a9f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1f8cf9d79fdd4e3a8b46fb3022a12a9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1f8cf9d79fdd4e3a8b46fb3022a12a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1f8cf9d79fdd4e3a8b46fb3022a12a9f"}]}] May 11 07:38:33.575979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1001883112 May 11 07:38:33.575979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 1f8cf9d79fdd4e3a8b46fb3022a12a9f May 11 07:38:33.575979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1001883112 May 11 07:38:33.575979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-VolumesSnapshotsTestJSON-1001883112-project May 11 07:38:33.575979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:38:33.575979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:38:33.575979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: f45a14e589ba491f90452d8923620358 May 11 07:38:33.575979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1001883112-project May 11 07:38:33.575979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: May 11 07:38:33.575979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.575979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '77fe36c7-e6aa-4621-aaf9-13a32aca95aa'} May 11 07:38:33.575979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. (HTTP 404) (Request-ID: req-869cbf60-9567-4d7d-a33d-29852e03ca92) May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:38:33.577391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 07:38:33.578892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 07:38:33.579826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:38:33.584087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.584087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.584087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:38:33.584087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.584087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:33.584087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:38:33.584087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:38:33.584087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:38:33.584087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:38:33.584087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.584087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.584087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-04afb7d8-f660-4b18-989a-ff7189725745 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Returning 404 to user: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:38:33.584087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-04afb7d8-f660-4b18-989a-ff7189725745 tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa" status: 404 len: 109 microversion: 2.1 time: 0.208147 May 11 07:38:33.584087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 21/33] 10.222.0.36 () {58 vars in 1244 bytes} [Wed May 11 07:38:33 2022] GET /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa => generated 109 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:38:33.596763 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ce40400e-e9af-48d6-9177-c3ed797d8b6b tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19edf25e50>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:33.713109 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-ce40400e-e9af-48d6-9177-c3ed797d8b6b tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] HTTP exception thrown: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ce40400e-e9af-48d6-9177-c3ed797d8b6b tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Request method failure captured: May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: DELETE /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa HTTP/1.1 May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2fs1AJv6thWHtMeZbAhGMjIdAWNGG-vV8wD0uuqaBW3--B9TFhopSDcX6OijnEmBdoUqvGDJsw2rWKMJbIyLSoZGb6_kRlejPU2Rz6OYM5-QiuYE_IoNswh7lEW8jg9Qaj8jHhoKpr5VINPd2Zi4NG5xZX8Vp4oPu1hULAyFoH9HM4 May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 1f8cf9d79fdd4e3a8b46fb3022a12a9f May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1001883112 May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:38:33.715098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:38:33.716124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1f8cf9d79fdd4e3a8b46fb3022a12a9f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1f8cf9d79fdd4e3a8b46fb3022a12a9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1f8cf9d79fdd4e3a8b46fb3022a12a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1f8cf9d79fdd4e3a8b46fb3022a12a9f"}]}] May 11 07:38:33.716124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1001883112 May 11 07:38:33.716124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 1f8cf9d79fdd4e3a8b46fb3022a12a9f May 11 07:38:33.716124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1001883112 May 11 07:38:33.716124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-VolumesSnapshotsTestJSON-1001883112-project May 11 07:38:33.716124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:38:33.716124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:38:33.716124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: f45a14e589ba491f90452d8923620358 May 11 07:38:33.716124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1001883112-project May 11 07:38:33.716124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: May 11 07:38:33.716124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.716124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '77fe36c7-e6aa-4621-aaf9-13a32aca95aa'} May 11 07:38:33.716124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. (HTTP 404) (Request-ID: req-2f7a7870-c704-478d-935a-ee9c09df3780) May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:38:33.716734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 07:38:33.717731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 07:38:33.718693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:38:33.719574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.719574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.719574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:38:33.719574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.719574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:33.719574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:38:33.719574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:38:33.719574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:38:33.719574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:38:33.719574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.719574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.719574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ce40400e-e9af-48d6-9177-c3ed797d8b6b tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Returning 404 to user: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:38:33.719574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ce40400e-e9af-48d6-9177-c3ed797d8b6b tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa" status: 404 len: 109 microversion: 2.1 time: 0.127726 May 11 07:38:33.719574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 22/34] 10.222.0.36 () {58 vars in 1247 bytes} [Wed May 11 07:38:33 2022] DELETE /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:38:33.728900 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6de81704-e745-44af-9957-23c2008057fa tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Calling method '.version_select at 0x7f19edf25820>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:33.940565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Flavor limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:38:33.941044 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Image limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:38:33.941736 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Flavor pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:38:33.942228 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Image pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:38:33.942644 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:38:33.974803 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:33.981181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-6de81704-e745-44af-9957-23c2008057fa tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] HTTP exception thrown: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.981333 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:33.983588 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6de81704-e745-44af-9957-23c2008057fa tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Request method failure captured: May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa HTTP/1.1 May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2fs1AJv6thWHtMeZbAhGMjIdAWNGG-vV8wD0uuqaBW3--B9TFhopSDcX6OijnEmBdoUqvGDJsw2rWKMJbIyLSoZGb6_kRlejPU2Rz6OYM5-QiuYE_IoNswh7lEW8jg9Qaj8jHhoKpr5VINPd2Zi4NG5xZX8Vp4oPu1hULAyFoH9HM4 May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 1f8cf9d79fdd4e3a8b46fb3022a12a9f May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1001883112 May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:38:33.984504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:38:33.985821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1f8cf9d79fdd4e3a8b46fb3022a12a9f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1f8cf9d79fdd4e3a8b46fb3022a12a9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1f8cf9d79fdd4e3a8b46fb3022a12a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1f8cf9d79fdd4e3a8b46fb3022a12a9f"}]}] May 11 07:38:33.985821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1001883112 May 11 07:38:33.985821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 1f8cf9d79fdd4e3a8b46fb3022a12a9f May 11 07:38:33.985821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1001883112 May 11 07:38:33.985821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-VolumesSnapshotsTestJSON-1001883112-project May 11 07:38:33.985821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:38:33.985821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:38:33.985821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: f45a14e589ba491f90452d8923620358 May 11 07:38:33.985821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1001883112-project May 11 07:38:33.985821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: May 11 07:38:33.985821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.985821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '77fe36c7-e6aa-4621-aaf9-13a32aca95aa'} May 11 07:38:33.985821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. (HTTP 404) (Request-ID: req-9face606-8a08-4ba6-9e56-33d9d1fffa15) May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:38:33.986557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 07:38:33.987465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 07:38:33.988575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:38:33.989846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.989846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.989846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:38:33.989846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.989846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:38:33.989846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:38:33.989846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:38:33.989846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:38:33.989846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:38:33.989846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. May 11 07:38:33.989846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:38:33.992564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6de81704-e745-44af-9957-23c2008057fa tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] Returning 404 to user: Volume 77fe36c7-e6aa-4621-aaf9-13a32aca95aa could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:38:33.992564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-6de81704-e745-44af-9957-23c2008057fa tempest-VolumesSnapshotsTestJSON-1001883112 tempest-VolumesSnapshotsTestJSON-1001883112-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa" status: 404 len: 109 microversion: 2.1 time: 0.267402 May 11 07:38:33.992564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 23/35] 10.222.0.36 () {58 vars in 1244 bytes} [Wed May 11 07:38:33 2022] GET /compute/v2.1/os-volumes/77fe36c7-e6aa-4621-aaf9-13a32aca95aa => generated 109 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 07:38:33.996999 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:34.099324 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Getting quotas for project 5100c1cfe7f148058734c0da2d1497d4. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:38:34.118226 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Getting quotas for user cb70f7eb7b44487a9ee3f331c83f9e31 and project 5100c1cfe7f148058734c0da2d1497d4. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:38:34.164954 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Going to run 1 instances... {{(pid=123600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:38:34.167884 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:38:34.319214 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-5c0092bb-2609-4f09-b28c-46fc8623f965 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.964231 May 11 07:38:34.323940 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 13/36] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:38:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 07:38:34.339744 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-bc0f9b68-690a-4df1-9141-61292b156884 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:34.340383 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-bc0f9b68-690a-4df1-9141-61292b156884 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:34.374681 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1e4712bf-fe96-49cb-a8e7-333598639507 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:34.378473 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-1e4712bf-fe96-49cb-a8e7-333598639507 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:34.414673 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1e4712bf-fe96-49cb-a8e7-333598639507 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:34.415138 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1e4712bf-fe96-49cb-a8e7-333598639507 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:34.415939 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1e4712bf-fe96-49cb-a8e7-333598639507 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:34.416388 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1e4712bf-fe96-49cb-a8e7-333598639507 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:34.810509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-bc0f9b68-690a-4df1-9141-61292b156884 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:34.823968 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-bc0f9b68-690a-4df1-9141-61292b156884 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1221 microversion: 2.1 time: 0.492130 May 11 07:38:34.864242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 24/37] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:34 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1221 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:35.048284 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-1e4712bf-fe96-49cb-a8e7-333598639507 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:35.056236 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-1e4712bf-fe96-49cb-a8e7-333598639507 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1272 microversion: 2.1 time: 0.685873 May 11 07:38:35.059289 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 14/38] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:34 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1272 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:38:35.320265 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-808361913", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:38:35.567215 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.network.neutron [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] validate_networks() for [('c4d89019-bced-4db2-9253-82870fddaba6', None, None, None, None, None)] {{(pid=123599) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:38:36.077740 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-cff2be1e-7c2c-45a8-bf12-c3d9553df80e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:36.078625 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-cff2be1e-7c2c-45a8-bf12-c3d9553df80e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:36.090464 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cff2be1e-7c2c-45a8-bf12-c3d9553df80e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:36.098141 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cff2be1e-7c2c-45a8-bf12-c3d9553df80e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:36.100662 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cff2be1e-7c2c-45a8-bf12-c3d9553df80e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:36.103147 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cff2be1e-7c2c-45a8-bf12-c3d9553df80e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:36.559546 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-cff2be1e-7c2c-45a8-bf12-c3d9553df80e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:36.572495 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-cff2be1e-7c2c-45a8-bf12-c3d9553df80e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1272 microversion: 2.1 time: 0.498890 May 11 07:38:36.575126 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 15/39] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:36 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1272 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:38:37.594460 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-995680d3-e7c8-4bea-9539-d8549740c041 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:37.596744 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-995680d3-e7c8-4bea-9539-d8549740c041 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:37.614786 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-995680d3-e7c8-4bea-9539-d8549740c041 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:37.616708 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-995680d3-e7c8-4bea-9539-d8549740c041 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:37.619625 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-995680d3-e7c8-4bea-9539-d8549740c041 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:37.623801 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-995680d3-e7c8-4bea-9539-d8549740c041 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:38.927268 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Flavor limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:38:38.930657 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Image limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:38:38.939335 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Flavor pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:38:38.939335 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Image pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:38:38.939335 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:38:38.949472 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-995680d3-e7c8-4bea-9539-d8549740c041 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:38.980162 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:38.981066 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-995680d3-e7c8-4bea-9539-d8549740c041 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1314 microversion: 2.1 time: 1.390744 May 11 07:38:38.983897 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:38.986574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:38.988923 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:38.995694 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 16/40] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:37 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1314 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:39.092762 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Getting quotas for project 5100c1cfe7f148058734c0da2d1497d4. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:38:39.109797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Getting quotas for user cb70f7eb7b44487a9ee3f331c83f9e31 and project 5100c1cfe7f148058734c0da2d1497d4. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:38:39.162833 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Going to run 1 instances... {{(pid=123599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:38:39.165729 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:38:39.380834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-edba171c-a972-4d2e-ba02-524d36bc15d2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.066153 May 11 07:38:39.382330 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 25/41] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:38:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 4070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:38:39.392638 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-78a9fd3c-f4ce-4694-be58-4e5d04d0bb95 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:39.393534 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-78a9fd3c-f4ce-4694-be58-4e5d04d0bb95 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:40.014738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-fe6924a2-ac1a-47cb-8d2a-2e6fc2e6be0f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:40.018623 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-fe6924a2-ac1a-47cb-8d2a-2e6fc2e6be0f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:40.030110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fe6924a2-ac1a-47cb-8d2a-2e6fc2e6be0f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:40.031191 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-78a9fd3c-f4ce-4694-be58-4e5d04d0bb95 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:40.041650 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fe6924a2-ac1a-47cb-8d2a-2e6fc2e6be0f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:40.042737 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fe6924a2-ac1a-47cb-8d2a-2e6fc2e6be0f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:40.043196 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fe6924a2-ac1a-47cb-8d2a-2e6fc2e6be0f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:40.072006 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-78a9fd3c-f4ce-4694-be58-4e5d04d0bb95 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1221 microversion: 2.1 time: 0.682632 May 11 07:38:40.084485 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 17/42] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:39 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1221 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:40.799688 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-fe6924a2-ac1a-47cb-8d2a-2e6fc2e6be0f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:40.813182 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-fe6924a2-ac1a-47cb-8d2a-2e6fc2e6be0f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1314 microversion: 2.1 time: 0.802974 May 11 07:38:40.814917 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 26/43] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:40 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1314 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:38:41.094639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a3417564-0102-4263-ba51-28417bf5a3f2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:41.095284 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a3417564-0102-4263-ba51-28417bf5a3f2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:41.105401 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a3417564-0102-4263-ba51-28417bf5a3f2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:41.107636 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a3417564-0102-4263-ba51-28417bf5a3f2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:41.111307 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a3417564-0102-4263-ba51-28417bf5a3f2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:41.114212 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a3417564-0102-4263-ba51-28417bf5a3f2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:41.326134 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a3417564-0102-4263-ba51-28417bf5a3f2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:41.334808 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a3417564-0102-4263-ba51-28417bf5a3f2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1273 microversion: 2.1 time: 0.245066 May 11 07:38:41.346888 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 18/44] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:41 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:41.671758 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1809007786", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a507c15c-cc52-449f-920c-1f23d1b31239"}], "security_groups": [{"name": "tempest-securitygroup--896014323"}], "key_name": "tempest-keypair-104399395", "user_data": "}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:38:41.833290 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-401474c1-1586-49ca-b7ce-255dcb252431 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:41.834468 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-401474c1-1586-49ca-b7ce-255dcb252431 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:41.855373 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-401474c1-1586-49ca-b7ce-255dcb252431 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:41.856170 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-401474c1-1586-49ca-b7ce-255dcb252431 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:41.861364 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-401474c1-1586-49ca-b7ce-255dcb252431 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:41.862144 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-401474c1-1586-49ca-b7ce-255dcb252431 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:43.649661 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.network.neutron [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] validate_networks() for [('a507c15c-cc52-449f-920c-1f23d1b31239', None, None, None, None, None)] {{(pid=123599) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:38:43.943277 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-401474c1-1586-49ca-b7ce-255dcb252431 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:43.951774 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-401474c1-1586-49ca-b7ce-255dcb252431 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1314 microversion: 2.1 time: 2.122893 May 11 07:38:43.956140 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 19/45] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:41 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1314 bytes in 2128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:43.976115 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-173baa0b-ac51-42b2-ad7d-5d6ef4280f34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:43.978545 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-173baa0b-ac51-42b2-ad7d-5d6ef4280f34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:44.015638 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-173baa0b-ac51-42b2-ad7d-5d6ef4280f34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:44.016445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-173baa0b-ac51-42b2-ad7d-5d6ef4280f34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:44.021047 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-173baa0b-ac51-42b2-ad7d-5d6ef4280f34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:44.021783 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-173baa0b-ac51-42b2-ad7d-5d6ef4280f34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:44.165317 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-173baa0b-ac51-42b2-ad7d-5d6ef4280f34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:44.176229 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-173baa0b-ac51-42b2-ad7d-5d6ef4280f34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1279 microversion: 2.1 time: 0.217441 May 11 07:38:44.187485 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 20/46] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:43 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1279 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:44.665357 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-64270581-a81c-4c08-907c-28fbf26ac9b2 req-cb44e69e-fddd-4343-a8c0-b55120d38453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5fa53db-5b31-4554-8d58-560e0c4028b1", "tag": "85426f35-70c3-4ad3-a864-509a1e6017ca"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:38:44.698368 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-64270581-a81c-4c08-907c-28fbf26ac9b2 req-cb44e69e-fddd-4343-a8c0-b55120d38453 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:44.699694 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-64270581-a81c-4c08-907c-28fbf26ac9b2 req-cb44e69e-fddd-4343-a8c0-b55120d38453 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:44.760858 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-64270581-a81c-4c08-907c-28fbf26ac9b2 req-cb44e69e-fddd-4343-a8c0-b55120d38453 service nova] Creating event network-changed:85426f35-70c3-4ad3-a864-509a1e6017ca for instance a5fa53db-5b31-4554-8d58-560e0c4028b1 on hv-cinder-83699 May 11 07:38:44.770991 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-64270581-a81c-4c08-907c-28fbf26ac9b2 req-cb44e69e-fddd-4343-a8c0-b55120d38453 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123600) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 11 07:38:44.773334 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-17e7bce8-62e8-44ce-a73c-9c8b5e25acc8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:44.779881 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-17e7bce8-62e8-44ce-a73c-9c8b5e25acc8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:44.780950 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-17e7bce8-62e8-44ce-a73c-9c8b5e25acc8 None None] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:44.782336 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-17e7bce8-62e8-44ce-a73c-9c8b5e25acc8 None None] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:44.803788 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.compute.rpcapi [None req-17e7bce8-62e8-44ce-a73c-9c8b5e25acc8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 11 07:38:44.804939 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-17e7bce8-62e8-44ce-a73c-9c8b5e25acc8 None None] Releasing lock "compute-rpcapi-router" {{(pid=123600) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 11 07:38:44.832733 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-17e7bce8-62e8-44ce-a73c-9c8b5e25acc8 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.643759 May 11 07:38:44.833678 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 21/47] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:44.971690 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c7539ef0-30f5-4757-ac9a-a0b5a4545688 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:44.973733 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c7539ef0-30f5-4757-ac9a-a0b5a4545688 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:44.983663 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c7539ef0-30f5-4757-ac9a-a0b5a4545688 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:44.984844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c7539ef0-30f5-4757-ac9a-a0b5a4545688 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:44.986283 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c7539ef0-30f5-4757-ac9a-a0b5a4545688 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:44.986913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c7539ef0-30f5-4757-ac9a-a0b5a4545688 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:45.578709 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c7539ef0-30f5-4757-ac9a-a0b5a4545688 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:45.594197 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c7539ef0-30f5-4757-ac9a-a0b5a4545688 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1314 microversion: 2.1 time: 0.625861 May 11 07:38:45.595255 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 22/48] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:44 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:45.612317 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-fc22089e-9313-402b-8b8f-48a255fc22fa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:45.613190 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-fc22089e-9313-402b-8b8f-48a255fc22fa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:45.632876 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fc22089e-9313-402b-8b8f-48a255fc22fa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:45.634806 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fc22089e-9313-402b-8b8f-48a255fc22fa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:45.639988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fc22089e-9313-402b-8b8f-48a255fc22fa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:45.642555 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fc22089e-9313-402b-8b8f-48a255fc22fa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:46.131767 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-fc22089e-9313-402b-8b8f-48a255fc22fa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:46.147301 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-fc22089e-9313-402b-8b8f-48a255fc22fa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1321 microversion: 2.1 time: 0.547683 May 11 07:38:46.151890 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 23/49] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:45 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1321 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:46.191530 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Flavor limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:38:46.192512 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Image limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:38:46.193167 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Flavor pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:38:46.193822 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Image pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:38:46.194416 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:38:46.221377 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:46.222547 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:46.231296 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:46.232763 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:46.311359 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Getting quotas for project 075ba180d52b46ad9cd3334520bcfb89. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:38:46.322349 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Getting quotas for user c6bb9dabb1fc46dda1fe1906ab248c57 and project 075ba180d52b46ad9cd3334520bcfb89. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:38:46.348677 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Going to run 1 instances... {{(pid=123599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:38:46.354689 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:38:46.476275 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-f01ef17d-bcf4-4c88-80ba-8a030efdf247 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.794709 May 11 07:38:46.489243 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a2d30dec-ebbd-44b4-8194-c5eac8ccb0cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:46.490228 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a2d30dec-ebbd-44b4-8194-c5eac8ccb0cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:46.491311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 27/50] 10.222.0.36 () {62 vars in 1187 bytes} [Wed May 11 07:38:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 4826 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 11 07:38:46.602612 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a2d30dec-ebbd-44b4-8194-c5eac8ccb0cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:46.612661 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-97df7a89-5567-4199-9e4d-650dfc429bc7 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:46.613281 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-97df7a89-5567-4199-9e4d-650dfc429bc7 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:46.614275 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a2d30dec-ebbd-44b4-8194-c5eac8ccb0cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:46.615986 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a2d30dec-ebbd-44b4-8194-c5eac8ccb0cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:46.618028 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a2d30dec-ebbd-44b4-8194-c5eac8ccb0cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1281 microversion: 2.20 time: 0.132314 May 11 07:38:46.619275 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 24/51] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:38:46 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1281 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:38:46.630668 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-97df7a89-5567-4199-9e4d-650dfc429bc7 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:46.635668 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-97df7a89-5567-4199-9e4d-650dfc429bc7 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:46.636547 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-97df7a89-5567-4199-9e4d-650dfc429bc7 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:46.637006 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-97df7a89-5567-4199-9e4d-650dfc429bc7 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:47.167331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-43d12bbf-6fd5-4b8e-98eb-56001bbf859e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:47.168745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-43d12bbf-6fd5-4b8e-98eb-56001bbf859e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:47.189256 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-43d12bbf-6fd5-4b8e-98eb-56001bbf859e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:47.192180 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-43d12bbf-6fd5-4b8e-98eb-56001bbf859e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:47.194148 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-43d12bbf-6fd5-4b8e-98eb-56001bbf859e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:47.204200 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-43d12bbf-6fd5-4b8e-98eb-56001bbf859e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:48.091202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-97df7a89-5567-4199-9e4d-650dfc429bc7 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:48.123712 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-97df7a89-5567-4199-9e4d-650dfc429bc7 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1314 microversion: 2.1 time: 1.514220 May 11 07:38:48.132082 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 28/52] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:46 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1314 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:38:48.176166 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d252161d-3fb2-45aa-9e62-b66dbaecb36b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:48.176914 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d252161d-3fb2-45aa-9e62-b66dbaecb36b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:48.198593 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d252161d-3fb2-45aa-9e62-b66dbaecb36b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:48.199194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d252161d-3fb2-45aa-9e62-b66dbaecb36b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:48.200045 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d252161d-3fb2-45aa-9e62-b66dbaecb36b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:48.200484 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d252161d-3fb2-45aa-9e62-b66dbaecb36b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:48.228209 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-43d12bbf-6fd5-4b8e-98eb-56001bbf859e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:48.248221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-43d12bbf-6fd5-4b8e-98eb-56001bbf859e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1321 microversion: 2.1 time: 1.082947 May 11 07:38:48.255549 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 25/53] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:47 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1321 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:48.480232 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d252161d-3fb2-45aa-9e62-b66dbaecb36b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:48.490088 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d252161d-3fb2-45aa-9e62-b66dbaecb36b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:48.492143 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d252161d-3fb2-45aa-9e62-b66dbaecb36b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:48.493302 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d252161d-3fb2-45aa-9e62-b66dbaecb36b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1277 microversion: 2.20 time: 0.358787 May 11 07:38:48.494796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 29/54] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:38:48 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1277 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:38:48.949990 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-80727d6b-5a8e-429d-a6a5-7fc232272aa7 req-0f5bae41-ffc7-47c2-8338-dfa4786f0cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40960ef3-1318-49f6-9a5e-c5b12205f0f6", "tag": "be1479b9-6c95-4550-bed0-2553312bf4f3"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:38:48.990014 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-80727d6b-5a8e-429d-a6a5-7fc232272aa7 req-0f5bae41-ffc7-47c2-8338-dfa4786f0cae service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:48.992679 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-80727d6b-5a8e-429d-a6a5-7fc232272aa7 req-0f5bae41-ffc7-47c2-8338-dfa4786f0cae service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:49.008560 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-80727d6b-5a8e-429d-a6a5-7fc232272aa7 req-0f5bae41-ffc7-47c2-8338-dfa4786f0cae service nova] Creating event network-changed:be1479b9-6c95-4550-bed0-2553312bf4f3 for instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 on hv-cinder-83699 May 11 07:38:49.016005 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-80727d6b-5a8e-429d-a6a5-7fc232272aa7 req-0f5bae41-ffc7-47c2-8338-dfa4786f0cae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071415 May 11 07:38:49.017492 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 26/55] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:49.148903 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-57c0b41d-37f6-4aeb-a15a-dce9f5acdb24 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:49.149845 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-57c0b41d-37f6-4aeb-a15a-dce9f5acdb24 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:49.157511 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-57c0b41d-37f6-4aeb-a15a-dce9f5acdb24 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:49.160459 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-57c0b41d-37f6-4aeb-a15a-dce9f5acdb24 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:49.162659 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-57c0b41d-37f6-4aeb-a15a-dce9f5acdb24 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:49.163277 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-57c0b41d-37f6-4aeb-a15a-dce9f5acdb24 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:49.278295 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-0ccce3a8-e228-4948-970e-56e454049d6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:49.279963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-0ccce3a8-e228-4948-970e-56e454049d6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:49.294052 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0ccce3a8-e228-4948-970e-56e454049d6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:49.295259 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0ccce3a8-e228-4948-970e-56e454049d6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:49.300597 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0ccce3a8-e228-4948-970e-56e454049d6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:49.301997 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0ccce3a8-e228-4948-970e-56e454049d6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:49.510619 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-57c0b41d-37f6-4aeb-a15a-dce9f5acdb24 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:49.523423 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-57c0b41d-37f6-4aeb-a15a-dce9f5acdb24 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1314 microversion: 2.1 time: 0.378650 May 11 07:38:49.531475 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 30/56] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:49 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:49.540333 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2abe5a3f-927a-4738-a824-3faed0691f0e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:49.540951 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2abe5a3f-927a-4738-a824-3faed0691f0e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:49.555951 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2abe5a3f-927a-4738-a824-3faed0691f0e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:49.556411 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2abe5a3f-927a-4738-a824-3faed0691f0e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:49.568060 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2abe5a3f-927a-4738-a824-3faed0691f0e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:49.568838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2abe5a3f-927a-4738-a824-3faed0691f0e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:49.785190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2abe5a3f-927a-4738-a824-3faed0691f0e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:49.808051 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2abe5a3f-927a-4738-a824-3faed0691f0e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:49.819040 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2abe5a3f-927a-4738-a824-3faed0691f0e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:49.823657 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2abe5a3f-927a-4738-a824-3faed0691f0e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1351 microversion: 2.20 time: 0.287473 May 11 07:38:49.835065 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 31/57] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:38:49 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1351 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:38:49.862358 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0ccce3a8-e228-4948-970e-56e454049d6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:49.871818 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-0ccce3a8-e228-4948-970e-56e454049d6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1321 microversion: 2.1 time: 0.599007 May 11 07:38:49.873989 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 27/58] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:49 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1321 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:38:50.053440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-5a75485b-c3eb-4a3e-b7ef-3d905f69d332 req-f5cee71b-2572-4fa9-bd60-8b780428cc8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a9a7c6d-2396-446b-9d87-3a9fb36d031c", "tag": "aa4cf226-9012-4577-8ddd-7b9559ce1960"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:38:50.074544 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-5a75485b-c3eb-4a3e-b7ef-3d905f69d332 req-f5cee71b-2572-4fa9-bd60-8b780428cc8c service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:50.075379 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-5a75485b-c3eb-4a3e-b7ef-3d905f69d332 req-f5cee71b-2572-4fa9-bd60-8b780428cc8c service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:50.111644 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-5a75485b-c3eb-4a3e-b7ef-3d905f69d332 req-f5cee71b-2572-4fa9-bd60-8b780428cc8c service nova] Creating event network-changed:aa4cf226-9012-4577-8ddd-7b9559ce1960 for instance 7a9a7c6d-2396-446b-9d87-3a9fb36d031c on hv-cinder-83699 May 11 07:38:50.112192 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-5a75485b-c3eb-4a3e-b7ef-3d905f69d332 req-f5cee71b-2572-4fa9-bd60-8b780428cc8c service nova] Acquired lock "compute-rpcapi-router" {{(pid=123599) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 11 07:38:50.113386 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84552b8e-5b8d-453f-a6fe-b9fdc294df37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:50.113939 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84552b8e-5b8d-453f-a6fe-b9fdc294df37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:50.114739 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84552b8e-5b8d-453f-a6fe-b9fdc294df37 None None] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:50.115264 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84552b8e-5b8d-453f-a6fe-b9fdc294df37 None None] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:50.124869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.compute.rpcapi [None req-84552b8e-5b8d-453f-a6fe-b9fdc294df37 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 11 07:38:50.125824 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84552b8e-5b8d-453f-a6fe-b9fdc294df37 None None] Releasing lock "compute-rpcapi-router" {{(pid=123599) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 11 07:38:50.145528 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-84552b8e-5b8d-453f-a6fe-b9fdc294df37 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.308559 May 11 07:38:50.149992 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 32/59] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:50.547787 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-128161de-3e9a-450a-8a69-b42acd5281fe tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:50.548982 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-128161de-3e9a-450a-8a69-b42acd5281fe tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:50.560807 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-128161de-3e9a-450a-8a69-b42acd5281fe tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:50.562431 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-128161de-3e9a-450a-8a69-b42acd5281fe tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:50.562431 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-128161de-3e9a-450a-8a69-b42acd5281fe tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:50.562897 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-128161de-3e9a-450a-8a69-b42acd5281fe tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:50.842621 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-bab69d3e-d2ff-4919-a32f-1afc96ea40e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:50.843322 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-bab69d3e-d2ff-4919-a32f-1afc96ea40e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:50.854011 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bab69d3e-d2ff-4919-a32f-1afc96ea40e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:50.854489 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bab69d3e-d2ff-4919-a32f-1afc96ea40e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:50.855292 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bab69d3e-d2ff-4919-a32f-1afc96ea40e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:50.857350 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bab69d3e-d2ff-4919-a32f-1afc96ea40e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:51.051969 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-bab69d3e-d2ff-4919-a32f-1afc96ea40e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:51.066939 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-bab69d3e-d2ff-4919-a32f-1afc96ea40e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:51.069956 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-bab69d3e-d2ff-4919-a32f-1afc96ea40e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:51.080445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-bab69d3e-d2ff-4919-a32f-1afc96ea40e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1339 microversion: 2.20 time: 0.242640 May 11 07:38:51.083200 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 33/60] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:38:50 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1339 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:38:51.089490 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ddb026ef-93e2-4981-8e47-a137c6e90460 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:51.090589 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ddb026ef-93e2-4981-8e47-a137c6e90460 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:51.111390 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ddb026ef-93e2-4981-8e47-a137c6e90460 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:51.112089 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ddb026ef-93e2-4981-8e47-a137c6e90460 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:51.125222 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ddb026ef-93e2-4981-8e47-a137c6e90460 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:51.126111 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ddb026ef-93e2-4981-8e47-a137c6e90460 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:51.179518 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-128161de-3e9a-450a-8a69-b42acd5281fe tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:51.188097 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-128161de-3e9a-450a-8a69-b42acd5281fe tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1314 microversion: 2.1 time: 0.644365 May 11 07:38:51.188686 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 28/61] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:50 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:51.464574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ddb026ef-93e2-4981-8e47-a137c6e90460 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:51.495957 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ddb026ef-93e2-4981-8e47-a137c6e90460 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1321 microversion: 2.1 time: 0.411411 May 11 07:38:51.500508 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 34/62] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:51 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:52.099796 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2decb6d4-867b-42c7-96cc-a427d19d37ea tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:52.100927 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2decb6d4-867b-42c7-96cc-a427d19d37ea tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:52.116449 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2decb6d4-867b-42c7-96cc-a427d19d37ea tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:52.118110 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2decb6d4-867b-42c7-96cc-a427d19d37ea tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:52.120816 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2decb6d4-867b-42c7-96cc-a427d19d37ea tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:52.121263 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2decb6d4-867b-42c7-96cc-a427d19d37ea tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:52.204277 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3fb591ce-1010-4d5e-bad5-412aee00ab8e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:52.205068 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-3fb591ce-1010-4d5e-bad5-412aee00ab8e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:52.219967 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3fb591ce-1010-4d5e-bad5-412aee00ab8e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:52.220427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3fb591ce-1010-4d5e-bad5-412aee00ab8e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:52.221212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3fb591ce-1010-4d5e-bad5-412aee00ab8e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:52.221852 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3fb591ce-1010-4d5e-bad5-412aee00ab8e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:52.446063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-2decb6d4-867b-42c7-96cc-a427d19d37ea tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:52.456110 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-2decb6d4-867b-42c7-96cc-a427d19d37ea tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:52.458585 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-2decb6d4-867b-42c7-96cc-a427d19d37ea tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:52.461572 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2decb6d4-867b-42c7-96cc-a427d19d37ea tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1406 microversion: 2.20 time: 0.367083 May 11 07:38:52.463547 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 29/63] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:38:52 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1406 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:38:52.518814 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e763aa8f-46a4-46f8-a514-df5ed8c2d6c6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:52.520485 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e763aa8f-46a4-46f8-a514-df5ed8c2d6c6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:52.529785 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e763aa8f-46a4-46f8-a514-df5ed8c2d6c6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:52.532369 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e763aa8f-46a4-46f8-a514-df5ed8c2d6c6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:52.534403 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e763aa8f-46a4-46f8-a514-df5ed8c2d6c6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:52.536413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e763aa8f-46a4-46f8-a514-df5ed8c2d6c6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:52.538186 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-3fb591ce-1010-4d5e-bad5-412aee00ab8e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:52.547501 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-3fb591ce-1010-4d5e-bad5-412aee00ab8e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1314 microversion: 2.1 time: 0.347140 May 11 07:38:52.548085 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 35/64] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:52 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:52.690146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e763aa8f-46a4-46f8-a514-df5ed8c2d6c6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:52.699093 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e763aa8f-46a4-46f8-a514-df5ed8c2d6c6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1321 microversion: 2.1 time: 0.185872 May 11 07:38:52.700238 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 30/65] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:52 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:53.480408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3af4969c-5916-43e6-a904-40295c8723ec tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:53.481023 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-3af4969c-5916-43e6-a904-40295c8723ec tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:53.491287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3af4969c-5916-43e6-a904-40295c8723ec tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:53.491734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3af4969c-5916-43e6-a904-40295c8723ec tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:53.492810 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3af4969c-5916-43e6-a904-40295c8723ec tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:53.493336 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3af4969c-5916-43e6-a904-40295c8723ec tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:53.565035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8fe80f17-e611-4c77-9176-d7abf1eb1de4 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:53.565689 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8fe80f17-e611-4c77-9176-d7abf1eb1de4 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:53.576335 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8fe80f17-e611-4c77-9176-d7abf1eb1de4 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:53.577757 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8fe80f17-e611-4c77-9176-d7abf1eb1de4 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:53.578566 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8fe80f17-e611-4c77-9176-d7abf1eb1de4 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:53.579014 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8fe80f17-e611-4c77-9176-d7abf1eb1de4 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:53.798857 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-3af4969c-5916-43e6-a904-40295c8723ec tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:53.811312 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-3af4969c-5916-43e6-a904-40295c8723ec tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:53.813646 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-3af4969c-5916-43e6-a904-40295c8723ec tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:53.815043 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-3af4969c-5916-43e6-a904-40295c8723ec tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1406 microversion: 2.20 time: 0.338571 May 11 07:38:53.815745 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 36/66] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:38:53 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:38:53.821343 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6541c7d2-0599-483e-a8df-8b478b3cc42a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:53.821971 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-6541c7d2-0599-483e-a8df-8b478b3cc42a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:53.828794 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6541c7d2-0599-483e-a8df-8b478b3cc42a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:53.829248 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6541c7d2-0599-483e-a8df-8b478b3cc42a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:53.831195 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6541c7d2-0599-483e-a8df-8b478b3cc42a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:53.831636 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6541c7d2-0599-483e-a8df-8b478b3cc42a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:53.874589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8fe80f17-e611-4c77-9176-d7abf1eb1de4 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:53.885331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8fe80f17-e611-4c77-9176-d7abf1eb1de4 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1314 microversion: 2.1 time: 0.324837 May 11 07:38:53.886049 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 31/67] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:53 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:54.037737 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-6541c7d2-0599-483e-a8df-8b478b3cc42a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:54.046896 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-6541c7d2-0599-483e-a8df-8b478b3cc42a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1321 microversion: 2.1 time: 0.228708 May 11 07:38:54.047946 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 37/68] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:53 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:54.840666 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e7cf9cf4-716b-41f4-b10d-e5715f544403 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:54.842968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e7cf9cf4-716b-41f4-b10d-e5715f544403 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:54.860168 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e7cf9cf4-716b-41f4-b10d-e5715f544403 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:54.861632 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e7cf9cf4-716b-41f4-b10d-e5715f544403 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:54.863644 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e7cf9cf4-716b-41f4-b10d-e5715f544403 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:54.864756 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e7cf9cf4-716b-41f4-b10d-e5715f544403 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:54.905377 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-11b4066e-ccfb-4d2b-b1ec-b2d24ec1b667 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:54.906009 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-11b4066e-ccfb-4d2b-b1ec-b2d24ec1b667 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:54.920172 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-11b4066e-ccfb-4d2b-b1ec-b2d24ec1b667 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:54.920944 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-11b4066e-ccfb-4d2b-b1ec-b2d24ec1b667 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:54.933325 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-11b4066e-ccfb-4d2b-b1ec-b2d24ec1b667 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:54.933814 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-11b4066e-ccfb-4d2b-b1ec-b2d24ec1b667 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:55.507952 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e7cf9cf4-716b-41f4-b10d-e5715f544403 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:55.515917 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-11b4066e-ccfb-4d2b-b1ec-b2d24ec1b667 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:55.516596 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e7cf9cf4-716b-41f4-b10d-e5715f544403 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:55.518213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e7cf9cf4-716b-41f4-b10d-e5715f544403 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:55.519364 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e7cf9cf4-716b-41f4-b10d-e5715f544403 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1406 microversion: 2.20 time: 0.687512 May 11 07:38:55.528486 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 32/69] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:38:54 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1406 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:38:55.530850 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-11b4066e-ccfb-4d2b-b1ec-b2d24ec1b667 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1314 microversion: 2.1 time: 0.628541 May 11 07:38:55.538246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d29f57f7-a1b0-4cf3-bfb6-bc4f63478b34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:55.539082 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d29f57f7-a1b0-4cf3-bfb6-bc4f63478b34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:55.543304 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 38/70] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:54 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:55.554727 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d29f57f7-a1b0-4cf3-bfb6-bc4f63478b34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:55.555183 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d29f57f7-a1b0-4cf3-bfb6-bc4f63478b34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:55.558657 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d29f57f7-a1b0-4cf3-bfb6-bc4f63478b34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:55.559145 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d29f57f7-a1b0-4cf3-bfb6-bc4f63478b34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:55.869042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-dea898d9-8c96-4868-b592-088ab5b1fb8e req-516e763c-5622-4af1-9c4a-9f20ae85a830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5fa53db-5b31-4554-8d58-560e0c4028b1", "name": "network-vif-plugged", "status": "completed", "tag": "85426f35-70c3-4ad3-a864-509a1e6017ca"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:38:55.884538 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-dea898d9-8c96-4868-b592-088ab5b1fb8e req-516e763c-5622-4af1-9c4a-9f20ae85a830 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:55.884991 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-dea898d9-8c96-4868-b592-088ab5b1fb8e req-516e763c-5622-4af1-9c4a-9f20ae85a830 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:55.904714 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-dea898d9-8c96-4868-b592-088ab5b1fb8e req-516e763c-5622-4af1-9c4a-9f20ae85a830 service nova] Creating event network-vif-plugged:85426f35-70c3-4ad3-a864-509a1e6017ca for instance a5fa53db-5b31-4554-8d58-560e0c4028b1 on hv-cinder-83699 May 11 07:38:55.927746 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-dea898d9-8c96-4868-b592-088ab5b1fb8e req-516e763c-5622-4af1-9c4a-9f20ae85a830 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.383095 May 11 07:38:55.932014 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 39/71] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:56.014897 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d29f57f7-a1b0-4cf3-bfb6-bc4f63478b34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:56.023980 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d29f57f7-a1b0-4cf3-bfb6-bc4f63478b34 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1321 microversion: 2.1 time: 0.492805 May 11 07:38:56.024595 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 33/72] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:55 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1321 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:56.274759 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-b8b9992a-690e-49cf-9ae4-54689e3ae9dc req-3cb0e0ae-a465-4bf8-a80e-6681f557d957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acfe41f4-cc5e-4cc7-bc04-ebff35bfd769", "tag": "1e8c8dbc-18a9-44e8-8ac6-273b984ed899"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:38:56.294258 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-b8b9992a-690e-49cf-9ae4-54689e3ae9dc req-3cb0e0ae-a465-4bf8-a80e-6681f557d957 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:56.294761 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-b8b9992a-690e-49cf-9ae4-54689e3ae9dc req-3cb0e0ae-a465-4bf8-a80e-6681f557d957 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:56.319973 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-b8b9992a-690e-49cf-9ae4-54689e3ae9dc req-3cb0e0ae-a465-4bf8-a80e-6681f557d957 service nova] Creating event network-changed:1e8c8dbc-18a9-44e8-8ac6-273b984ed899 for instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 on hv-cinder-83699 May 11 07:38:56.326998 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-b8b9992a-690e-49cf-9ae4-54689e3ae9dc req-3cb0e0ae-a465-4bf8-a80e-6681f557d957 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055979 May 11 07:38:56.328283 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 40/73] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:56.547377 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d6cddb38-85ee-42e3-9f1c-de866b123b44 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:56.548596 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d6cddb38-85ee-42e3-9f1c-de866b123b44 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:56.548759 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-daf1435a-9082-405d-8858-2d1e8e9b2f59 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:56.549415 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-daf1435a-9082-405d-8858-2d1e8e9b2f59 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:56.556278 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-daf1435a-9082-405d-8858-2d1e8e9b2f59 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:56.556758 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-daf1435a-9082-405d-8858-2d1e8e9b2f59 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:56.557524 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-daf1435a-9082-405d-8858-2d1e8e9b2f59 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:56.558186 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-daf1435a-9082-405d-8858-2d1e8e9b2f59 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:56.558891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d6cddb38-85ee-42e3-9f1c-de866b123b44 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:56.560381 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d6cddb38-85ee-42e3-9f1c-de866b123b44 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:56.561852 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d6cddb38-85ee-42e3-9f1c-de866b123b44 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:56.562717 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d6cddb38-85ee-42e3-9f1c-de866b123b44 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:56.942321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-daf1435a-9082-405d-8858-2d1e8e9b2f59 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:56.955304 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-daf1435a-9082-405d-8858-2d1e8e9b2f59 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1314 microversion: 2.1 time: 0.409648 May 11 07:38:56.957502 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 41/74] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:56 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:56.958998 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d6cddb38-85ee-42e3-9f1c-de866b123b44 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:56.974316 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d6cddb38-85ee-42e3-9f1c-de866b123b44 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:56.980653 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d6cddb38-85ee-42e3-9f1c-de866b123b44 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:56.982384 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d6cddb38-85ee-42e3-9f1c-de866b123b44 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1406 microversion: 2.20 time: 0.438585 May 11 07:38:56.998623 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 34/75] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:38:56 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:38:57.046911 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-1145ef16-7280-4110-9fa9-83d9533f803e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:57.047972 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-1145ef16-7280-4110-9fa9-83d9533f803e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:57.063127 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1145ef16-7280-4110-9fa9-83d9533f803e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:57.070788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1145ef16-7280-4110-9fa9-83d9533f803e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:57.071713 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1145ef16-7280-4110-9fa9-83d9533f803e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:57.072174 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1145ef16-7280-4110-9fa9-83d9533f803e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:57.368678 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-1145ef16-7280-4110-9fa9-83d9533f803e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:57.376693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-1145ef16-7280-4110-9fa9-83d9533f803e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1321 microversion: 2.1 time: 0.335199 May 11 07:38:57.380721 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 42/76] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:57 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:57.973717 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-72cee7b1-3718-416f-8102-f7ee093fe1fa tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:57.974279 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-72cee7b1-3718-416f-8102-f7ee093fe1fa tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:57.980494 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-72cee7b1-3718-416f-8102-f7ee093fe1fa tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:57.980984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-72cee7b1-3718-416f-8102-f7ee093fe1fa tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:57.981829 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-72cee7b1-3718-416f-8102-f7ee093fe1fa tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:57.982219 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-72cee7b1-3718-416f-8102-f7ee093fe1fa tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:58.002536 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2585551a-69d8-4520-be6a-bae707abb6d6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:58.003654 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2585551a-69d8-4520-be6a-bae707abb6d6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:58.010946 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2585551a-69d8-4520-be6a-bae707abb6d6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:58.011773 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2585551a-69d8-4520-be6a-bae707abb6d6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:58.012715 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2585551a-69d8-4520-be6a-bae707abb6d6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:58.013852 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2585551a-69d8-4520-be6a-bae707abb6d6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:58.272959 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-72cee7b1-3718-416f-8102-f7ee093fe1fa tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:58.280604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-72cee7b1-3718-416f-8102-f7ee093fe1fa tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1314 microversion: 2.1 time: 0.311668 May 11 07:38:58.290757 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 35/77] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:57 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:58.291653 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2585551a-69d8-4520-be6a-bae707abb6d6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:58.313080 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2585551a-69d8-4520-be6a-bae707abb6d6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:58.315560 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2585551a-69d8-4520-be6a-bae707abb6d6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:58.317310 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2585551a-69d8-4520-be6a-bae707abb6d6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1406 microversion: 2.20 time: 0.318570 May 11 07:38:58.318525 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 43/78] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:38:57 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:38:58.397218 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-34bd60c9-a46d-4afc-8482-286a29f9b57e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:58.398022 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-34bd60c9-a46d-4afc-8482-286a29f9b57e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:58.405520 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-34bd60c9-a46d-4afc-8482-286a29f9b57e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:58.408196 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-34bd60c9-a46d-4afc-8482-286a29f9b57e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:58.409067 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-34bd60c9-a46d-4afc-8482-286a29f9b57e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:58.409603 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-34bd60c9-a46d-4afc-8482-286a29f9b57e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:58.603428 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-34bd60c9-a46d-4afc-8482-286a29f9b57e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:58.613420 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-34bd60c9-a46d-4afc-8482-286a29f9b57e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1321 microversion: 2.1 time: 0.220644 May 11 07:38:58.614228 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 36/79] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:58 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:38:59.207661 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-71dcc5ef-35b9-4536-a63a-cee3d362c76d req-cf307f5f-2c97-4343-b265-6a9a22dbe89a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a9a7c6d-2396-446b-9d87-3a9fb36d031c", "name": "network-vif-plugged", "status": "completed", "tag": "aa4cf226-9012-4577-8ddd-7b9559ce1960"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:38:59.237275 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-71dcc5ef-35b9-4536-a63a-cee3d362c76d req-cf307f5f-2c97-4343-b265-6a9a22dbe89a service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:59.242910 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-71dcc5ef-35b9-4536-a63a-cee3d362c76d req-cf307f5f-2c97-4343-b265-6a9a22dbe89a service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:59.279960 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-71dcc5ef-35b9-4536-a63a-cee3d362c76d req-cf307f5f-2c97-4343-b265-6a9a22dbe89a service nova] Creating event network-vif-plugged:aa4cf226-9012-4577-8ddd-7b9559ce1960 for instance 7a9a7c6d-2396-446b-9d87-3a9fb36d031c on hv-cinder-83699 May 11 07:38:59.293750 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-71dcc5ef-35b9-4536-a63a-cee3d362c76d req-cf307f5f-2c97-4343-b265-6a9a22dbe89a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086870 May 11 07:38:59.297109 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 44/80] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:38:59.299075 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-30ae6e4d-d2a6-4b05-9e4e-6daef8ad754c tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:59.299618 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-30ae6e4d-d2a6-4b05-9e4e-6daef8ad754c tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:59.312250 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-30ae6e4d-d2a6-4b05-9e4e-6daef8ad754c tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:59.313100 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-30ae6e4d-d2a6-4b05-9e4e-6daef8ad754c tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:59.314892 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-30ae6e4d-d2a6-4b05-9e4e-6daef8ad754c tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:59.317490 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-30ae6e4d-d2a6-4b05-9e4e-6daef8ad754c tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:59.343722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0892d408-3a2c-4e4b-8b1a-4659d628e928 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:59.345024 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0892d408-3a2c-4e4b-8b1a-4659d628e928 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:59.383639 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0892d408-3a2c-4e4b-8b1a-4659d628e928 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:59.384688 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0892d408-3a2c-4e4b-8b1a-4659d628e928 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:59.387413 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0892d408-3a2c-4e4b-8b1a-4659d628e928 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:59.389608 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0892d408-3a2c-4e4b-8b1a-4659d628e928 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:59.847087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0892d408-3a2c-4e4b-8b1a-4659d628e928 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:59.857993 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0892d408-3a2c-4e4b-8b1a-4659d628e928 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:59.859660 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-30ae6e4d-d2a6-4b05-9e4e-6daef8ad754c tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:59.861153 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0892d408-3a2c-4e4b-8b1a-4659d628e928 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:38:59.863225 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0892d408-3a2c-4e4b-8b1a-4659d628e928 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1406 microversion: 2.20 time: 0.529330 May 11 07:38:59.864476 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 45/81] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:38:59 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1406 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:38:59.869634 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-825a57d0-546e-44f3-8aa1-6a1c5175d3d4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:38:59.870276 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-825a57d0-546e-44f3-8aa1-6a1c5175d3d4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:38:59.876172 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-825a57d0-546e-44f3-8aa1-6a1c5175d3d4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:59.876839 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-825a57d0-546e-44f3-8aa1-6a1c5175d3d4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:59.877850 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-825a57d0-546e-44f3-8aa1-6a1c5175d3d4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:38:59.878466 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-825a57d0-546e-44f3-8aa1-6a1c5175d3d4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:38:59.878693 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-30ae6e4d-d2a6-4b05-9e4e-6daef8ad754c tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1314 microversion: 2.1 time: 0.583451 May 11 07:38:59.879592 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 37/82] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:59 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:00.377060 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-825a57d0-546e-44f3-8aa1-6a1c5175d3d4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:00.385466 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-825a57d0-546e-44f3-8aa1-6a1c5175d3d4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1321 microversion: 2.1 time: 0.519420 May 11 07:39:00.386186 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 46/83] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:38:59 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1321 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:00.885933 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8cd29f0d-def6-4e72-b8c1-9809121f1af2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:00.886546 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8cd29f0d-def6-4e72-b8c1-9809121f1af2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:00.896328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-37c11e3e-6ab5-4c7d-98c3-88d8902dd8c2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:00.896944 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-37c11e3e-6ab5-4c7d-98c3-88d8902dd8c2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:00.913179 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8cd29f0d-def6-4e72-b8c1-9809121f1af2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:00.914290 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-37c11e3e-6ab5-4c7d-98c3-88d8902dd8c2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:00.914837 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8cd29f0d-def6-4e72-b8c1-9809121f1af2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:00.915740 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8cd29f0d-def6-4e72-b8c1-9809121f1af2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:00.916801 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-37c11e3e-6ab5-4c7d-98c3-88d8902dd8c2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:00.918835 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-37c11e3e-6ab5-4c7d-98c3-88d8902dd8c2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:00.921461 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8cd29f0d-def6-4e72-b8c1-9809121f1af2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:00.921674 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-37c11e3e-6ab5-4c7d-98c3-88d8902dd8c2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:01.424396 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-37c11e3e-6ab5-4c7d-98c3-88d8902dd8c2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:01.446138 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-37c11e3e-6ab5-4c7d-98c3-88d8902dd8c2 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1501 microversion: 2.1 time: 0.553974 May 11 07:39:01.446706 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 47/84] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:00 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1501 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:39:01.460594 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-80d72c6b-5bcd-4699-97fd-1951d4255d5f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:01.461212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-80d72c6b-5bcd-4699-97fd-1951d4255d5f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:01.483589 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-80d72c6b-5bcd-4699-97fd-1951d4255d5f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:01.486258 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-80d72c6b-5bcd-4699-97fd-1951d4255d5f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:01.488292 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-80d72c6b-5bcd-4699-97fd-1951d4255d5f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:01.490506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-80d72c6b-5bcd-4699-97fd-1951d4255d5f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:01.492542 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8cd29f0d-def6-4e72-b8c1-9809121f1af2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:01.514799 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8cd29f0d-def6-4e72-b8c1-9809121f1af2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:01.519545 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8cd29f0d-def6-4e72-b8c1-9809121f1af2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:01.521232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8cd29f0d-def6-4e72-b8c1-9809121f1af2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1406 microversion: 2.20 time: 0.639364 May 11 07:39:01.524588 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 38/85] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:39:00 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1406 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:39:01.539545 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-c24bbe40-b822-4eff-8168-922c4f82d24e req-2b4c860f-4661-41af-904a-99420a0f3952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40960ef3-1318-49f6-9a5e-c5b12205f0f6", "name": "network-vif-plugged", "status": "completed", "tag": "be1479b9-6c95-4550-bed0-2553312bf4f3"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:39:01.563090 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-c24bbe40-b822-4eff-8168-922c4f82d24e req-2b4c860f-4661-41af-904a-99420a0f3952 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:01.565359 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-c24bbe40-b822-4eff-8168-922c4f82d24e req-2b4c860f-4661-41af-904a-99420a0f3952 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:01.585962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-c24bbe40-b822-4eff-8168-922c4f82d24e req-2b4c860f-4661-41af-904a-99420a0f3952 service nova] Creating event network-vif-plugged:be1479b9-6c95-4550-bed0-2553312bf4f3 for instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 on hv-cinder-83699 May 11 07:39:01.595507 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-c24bbe40-b822-4eff-8168-922c4f82d24e req-2b4c860f-4661-41af-904a-99420a0f3952 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068664 May 11 07:39:01.596653 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 39/86] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:39:01.693532 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-80d72c6b-5bcd-4699-97fd-1951d4255d5f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:01.706028 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-80d72c6b-5bcd-4699-97fd-1951d4255d5f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1321 microversion: 2.1 time: 0.258439 May 11 07:39:01.706860 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 48/87] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:01 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:02.541881 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e97e8132-a868-4581-9e41-cba2e7c5150a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:02.542645 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e97e8132-a868-4581-9e41-cba2e7c5150a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:02.553317 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e97e8132-a868-4581-9e41-cba2e7c5150a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:02.557137 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e97e8132-a868-4581-9e41-cba2e7c5150a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:02.558162 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e97e8132-a868-4581-9e41-cba2e7c5150a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:02.558653 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e97e8132-a868-4581-9e41-cba2e7c5150a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:02.723395 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-363e0e7d-e421-4bc7-9364-3b604b64e675 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:02.724664 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-363e0e7d-e421-4bc7-9364-3b604b64e675 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:02.737331 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-363e0e7d-e421-4bc7-9364-3b604b64e675 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:02.737886 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-363e0e7d-e421-4bc7-9364-3b604b64e675 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:02.741440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-363e0e7d-e421-4bc7-9364-3b604b64e675 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:02.741917 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-363e0e7d-e421-4bc7-9364-3b604b64e675 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:02.783250 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e97e8132-a868-4581-9e41-cba2e7c5150a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:02.792185 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e97e8132-a868-4581-9e41-cba2e7c5150a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:02.798806 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e97e8132-a868-4581-9e41-cba2e7c5150a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:02.800155 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e97e8132-a868-4581-9e41-cba2e7c5150a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1406 microversion: 2.20 time: 0.263093 May 11 07:39:02.800953 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 40/88] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:39:02 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:39:02.925906 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-363e0e7d-e421-4bc7-9364-3b604b64e675 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:02.935081 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-363e0e7d-e421-4bc7-9364-3b604b64e675 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1516 microversion: 2.1 time: 0.215929 May 11 07:39:02.936498 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 49/89] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:02 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1516 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:02.957358 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a601a5f0-c7ad-4d16-82c0-61e0dce2c521 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:39:02.958876 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a601a5f0-c7ad-4d16-82c0-61e0dce2c521 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:02.967456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a601a5f0-c7ad-4d16-82c0-61e0dce2c521 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:02.969183 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a601a5f0-c7ad-4d16-82c0-61e0dce2c521 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:02.970307 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a601a5f0-c7ad-4d16-82c0-61e0dce2c521 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:02.971405 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a601a5f0-c7ad-4d16-82c0-61e0dce2c521 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:03.036503 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.objects.instance [None req-a601a5f0-c7ad-4d16-82c0-61e0dce2c521 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lazy-loading 'flavor' on Instance uuid 7a9a7c6d-2396-446b-9d87-3a9fb36d031c {{(pid=123600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:39:03.048493 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-235ef8eb-aab8-4b90-b6cf-2b6e2f96317a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47e88625-7e46-4f88-92cf-f26e296a2a89"}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:39:03.049922 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-235ef8eb-aab8-4b90-b6cf-2b6e2f96317a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:03.056171 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-235ef8eb-aab8-4b90-b6cf-2b6e2f96317a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:03.056868 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-235ef8eb-aab8-4b90-b6cf-2b6e2f96317a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:03.057918 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-235ef8eb-aab8-4b90-b6cf-2b6e2f96317a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:03.058630 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-235ef8eb-aab8-4b90-b6cf-2b6e2f96317a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:03.207983 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a601a5f0-c7ad-4d16-82c0-61e0dce2c521 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "POST /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c/action" status: 200 len: 32 microversion: 2.1 time: 0.254913 May 11 07:39:03.212483 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 41/90] 10.222.0.36 () {60 vars in 1277 bytes} [Wed May 11 07:39:02 2022] POST /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 07:39:03.218713 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c86f2245-762c-4dcf-b336-512f5e27eb13 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:03.219852 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c86f2245-762c-4dcf-b336-512f5e27eb13 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:03.227493 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c86f2245-762c-4dcf-b336-512f5e27eb13 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:03.228422 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c86f2245-762c-4dcf-b336-512f5e27eb13 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:03.229403 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c86f2245-762c-4dcf-b336-512f5e27eb13 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:03.230164 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c86f2245-762c-4dcf-b336-512f5e27eb13 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:03.430239 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c86f2245-762c-4dcf-b336-512f5e27eb13 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:03.438644 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c86f2245-762c-4dcf-b336-512f5e27eb13 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.224896 May 11 07:39:03.439417 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 42/91] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:03 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:03.677333 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-82acb589-5f0a-4a09-b6b3-3aee9e898e7a req-ff06cceb-58f1-4ef2-8a5c-4ec85aa24335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe41f4-cc5e-4cc7-bc04-ebff35bfd769", "name": "network-vif-plugged", "status": "completed", "tag": "1e8c8dbc-18a9-44e8-8ac6-273b984ed899"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:39:03.698188 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-82acb589-5f0a-4a09-b6b3-3aee9e898e7a req-ff06cceb-58f1-4ef2-8a5c-4ec85aa24335 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:03.699242 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-82acb589-5f0a-4a09-b6b3-3aee9e898e7a req-ff06cceb-58f1-4ef2-8a5c-4ec85aa24335 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:03.719396 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-82acb589-5f0a-4a09-b6b3-3aee9e898e7a req-ff06cceb-58f1-4ef2-8a5c-4ec85aa24335 service nova] Creating event network-vif-plugged:1e8c8dbc-18a9-44e8-8ac6-273b984ed899 for instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 on hv-cinder-83699 May 11 07:39:03.727612 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-82acb589-5f0a-4a09-b6b3-3aee9e898e7a req-ff06cceb-58f1-4ef2-8a5c-4ec85aa24335 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055327 May 11 07:39:03.728764 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 43/92] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:39:03.823372 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-00400eda-e042-4cce-948d-c61ed5efe51a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:03.824068 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-00400eda-e042-4cce-948d-c61ed5efe51a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:03.835063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00400eda-e042-4cce-948d-c61ed5efe51a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:03.835761 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00400eda-e042-4cce-948d-c61ed5efe51a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:03.836642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00400eda-e042-4cce-948d-c61ed5efe51a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:03.837317 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00400eda-e042-4cce-948d-c61ed5efe51a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:04.010888 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-00400eda-e042-4cce-948d-c61ed5efe51a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:04.019236 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-00400eda-e042-4cce-948d-c61ed5efe51a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:04.021801 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-00400eda-e042-4cce-948d-c61ed5efe51a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:04.023026 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-00400eda-e042-4cce-948d-c61ed5efe51a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1406 microversion: 2.20 time: 0.204059 May 11 07:39:04.024189 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 44/93] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:39:03 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:39:04.456529 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-922d2eed-de50-4119-a2df-19d442e10292 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:04.457440 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-922d2eed-de50-4119-a2df-19d442e10292 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:04.463142 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-922d2eed-de50-4119-a2df-19d442e10292 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:04.463588 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-922d2eed-de50-4119-a2df-19d442e10292 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:04.464633 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-922d2eed-de50-4119-a2df-19d442e10292 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:04.465269 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-922d2eed-de50-4119-a2df-19d442e10292 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:04.617168 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-922d2eed-de50-4119-a2df-19d442e10292 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:04.631263 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-922d2eed-de50-4119-a2df-19d442e10292 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.178381 May 11 07:39:04.632561 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 45/94] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:04 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:39:05.040002 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9d01b3c8-7d8c-4ee5-a4f2-1a9a1836ea87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:05.041357 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9d01b3c8-7d8c-4ee5-a4f2-1a9a1836ea87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:05.047729 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9d01b3c8-7d8c-4ee5-a4f2-1a9a1836ea87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:05.048482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9d01b3c8-7d8c-4ee5-a4f2-1a9a1836ea87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:05.049455 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9d01b3c8-7d8c-4ee5-a4f2-1a9a1836ea87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:05.050117 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9d01b3c8-7d8c-4ee5-a4f2-1a9a1836ea87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:05.215677 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9d01b3c8-7d8c-4ee5-a4f2-1a9a1836ea87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:05.225249 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9d01b3c8-7d8c-4ee5-a4f2-1a9a1836ea87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:05.227290 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9d01b3c8-7d8c-4ee5-a4f2-1a9a1836ea87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:05.228863 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9d01b3c8-7d8c-4ee5-a4f2-1a9a1836ea87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1406 microversion: 2.20 time: 0.192615 May 11 07:39:05.230466 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 46/95] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:39:05 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 07:39:05.648941 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4184a88a-4c3e-43e0-82d2-9d474cf27a40 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:05.649528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4184a88a-4c3e-43e0-82d2-9d474cf27a40 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:05.669480 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4184a88a-4c3e-43e0-82d2-9d474cf27a40 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:05.669962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4184a88a-4c3e-43e0-82d2-9d474cf27a40 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:05.670740 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4184a88a-4c3e-43e0-82d2-9d474cf27a40 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:05.671178 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4184a88a-4c3e-43e0-82d2-9d474cf27a40 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:05.751843 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-235ef8eb-aab8-4b90-b6cf-2b6e2f96317a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "POST /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.707066 May 11 07:39:05.753403 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 50/96] 10.222.0.36 () {60 vars in 1322 bytes} [Wed May 11 07:39:03 2022] POST /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1/os-volume_attachments => generated 194 bytes in 2709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:39:05.924699 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4184a88a-4c3e-43e0-82d2-9d474cf27a40 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:05.933626 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4184a88a-4c3e-43e0-82d2-9d474cf27a40 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.288878 May 11 07:39:05.934141 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 47/97] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:05 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:39:06.253954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b03b8c30-8a7a-44ee-a55a-8d8b803d6376 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:06.254838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-b03b8c30-8a7a-44ee-a55a-8d8b803d6376 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:06.270418 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b03b8c30-8a7a-44ee-a55a-8d8b803d6376 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:06.271129 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b03b8c30-8a7a-44ee-a55a-8d8b803d6376 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:06.275022 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b03b8c30-8a7a-44ee-a55a-8d8b803d6376 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:06.279303 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b03b8c30-8a7a-44ee-a55a-8d8b803d6376 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:06.625201 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-b03b8c30-8a7a-44ee-a55a-8d8b803d6376 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:06.636932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-b03b8c30-8a7a-44ee-a55a-8d8b803d6376 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:06.639199 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-b03b8c30-8a7a-44ee-a55a-8d8b803d6376 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:06.640396 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-b03b8c30-8a7a-44ee-a55a-8d8b803d6376 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1406 microversion: 2.20 time: 0.394240 May 11 07:39:06.644515 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 51/98] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:39:06 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1406 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:39:06.951609 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-365c032d-676e-4097-95d6-74b28c6848d7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:06.952710 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-365c032d-676e-4097-95d6-74b28c6848d7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:06.959317 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-365c032d-676e-4097-95d6-74b28c6848d7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:06.960703 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-365c032d-676e-4097-95d6-74b28c6848d7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:06.962033 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-365c032d-676e-4097-95d6-74b28c6848d7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:06.962950 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-365c032d-676e-4097-95d6-74b28c6848d7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:07.187661 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-365c032d-676e-4097-95d6-74b28c6848d7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:07.200557 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-365c032d-676e-4097-95d6-74b28c6848d7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.252288 May 11 07:39:07.201938 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 48/99] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:06 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:07.658542 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-85055d6d-2a48-4283-ab2b-24ed0140a66f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:07.659778 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-85055d6d-2a48-4283-ab2b-24ed0140a66f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:07.666542 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-85055d6d-2a48-4283-ab2b-24ed0140a66f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:07.671432 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-85055d6d-2a48-4283-ab2b-24ed0140a66f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:07.673306 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-85055d6d-2a48-4283-ab2b-24ed0140a66f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:07.675363 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-85055d6d-2a48-4283-ab2b-24ed0140a66f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:07.867170 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-85055d6d-2a48-4283-ab2b-24ed0140a66f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:07.878249 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-85055d6d-2a48-4283-ab2b-24ed0140a66f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:07.881183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-85055d6d-2a48-4283-ab2b-24ed0140a66f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:07.883072 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-85055d6d-2a48-4283-ab2b-24ed0140a66f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1406 microversion: 2.20 time: 0.227925 May 11 07:39:07.884538 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 52/100] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:39:07 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:39:08.219464 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-58befe3a-cdc8-4a85-afbe-b42275b30fa4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:08.221409 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-58befe3a-cdc8-4a85-afbe-b42275b30fa4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:08.229937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-58befe3a-cdc8-4a85-afbe-b42275b30fa4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:08.230641 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-58befe3a-cdc8-4a85-afbe-b42275b30fa4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:08.233152 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-58befe3a-cdc8-4a85-afbe-b42275b30fa4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:08.234453 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-58befe3a-cdc8-4a85-afbe-b42275b30fa4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:08.442206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-58befe3a-cdc8-4a85-afbe-b42275b30fa4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:08.452073 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-58befe3a-cdc8-4a85-afbe-b42275b30fa4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.236691 May 11 07:39:08.452778 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 49/101] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:08 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:08.903913 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a968b914-2eb1-44e4-9f22-3bde78c6f426 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:08.904696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a968b914-2eb1-44e4-9f22-3bde78c6f426 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:08.911123 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a968b914-2eb1-44e4-9f22-3bde78c6f426 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:08.911563 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a968b914-2eb1-44e4-9f22-3bde78c6f426 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:08.912412 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a968b914-2eb1-44e4-9f22-3bde78c6f426 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:08.912915 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a968b914-2eb1-44e4-9f22-3bde78c6f426 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:09.067456 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a968b914-2eb1-44e4-9f22-3bde78c6f426 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:09.075912 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a968b914-2eb1-44e4-9f22-3bde78c6f426 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:09.077461 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a968b914-2eb1-44e4-9f22-3bde78c6f426 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:09.079004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a968b914-2eb1-44e4-9f22-3bde78c6f426 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1598 microversion: 2.20 time: 0.178931 May 11 07:39:09.089648 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 53/102] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:39:08 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1598 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:39:09.097991 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7955c793-0809-4a29-ac9b-f293a5ac7c8b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:09.098476 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7955c793-0809-4a29-ac9b-f293a5ac7c8b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:09.104278 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7955c793-0809-4a29-ac9b-f293a5ac7c8b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:09.104728 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7955c793-0809-4a29-ac9b-f293a5ac7c8b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:09.105489 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7955c793-0809-4a29-ac9b-f293a5ac7c8b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:09.105950 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7955c793-0809-4a29-ac9b-f293a5ac7c8b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:09.192107 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7955c793-0809-4a29-ac9b-f293a5ac7c8b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096825 May 11 07:39:09.193982 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 50/103] 10.222.0.36 () {60 vars in 1315 bytes} [Wed May 11 07:39:09 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 07:39:09.469061 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-083f326b-a2cc-4243-828c-97b299b6cbff tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:09.469787 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-083f326b-a2cc-4243-828c-97b299b6cbff tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:09.476551 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-083f326b-a2cc-4243-828c-97b299b6cbff tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:09.477088 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-083f326b-a2cc-4243-828c-97b299b6cbff tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:09.478093 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-083f326b-a2cc-4243-828c-97b299b6cbff tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:09.478734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-083f326b-a2cc-4243-828c-97b299b6cbff tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:10.102021 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-083f326b-a2cc-4243-828c-97b299b6cbff tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:10.113888 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-083f326b-a2cc-4243-828c-97b299b6cbff tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.649364 May 11 07:39:10.116304 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 54/104] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:09 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:10.987244 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-ad5cb557-cabe-4bd5-93c3-3c4293b2acb2 req-37286426-dabd-4693-8340-ff6a92ef87cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acfe41f4-cc5e-4cc7-bc04-ebff35bfd769", "tag": "1e8c8dbc-18a9-44e8-8ac6-273b984ed899"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:39:10.996660 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-ad5cb557-cabe-4bd5-93c3-3c4293b2acb2 req-37286426-dabd-4693-8340-ff6a92ef87cc service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:10.997135 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-ad5cb557-cabe-4bd5-93c3-3c4293b2acb2 req-37286426-dabd-4693-8340-ff6a92ef87cc service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:11.018132 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-ad5cb557-cabe-4bd5-93c3-3c4293b2acb2 req-37286426-dabd-4693-8340-ff6a92ef87cc service nova] Creating event network-changed:1e8c8dbc-18a9-44e8-8ac6-273b984ed899 for instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 on hv-cinder-83699 May 11 07:39:11.029575 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-ad5cb557-cabe-4bd5-93c3-3c4293b2acb2 req-37286426-dabd-4693-8340-ff6a92ef87cc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045659 May 11 07:39:11.030704 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 51/105] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:39:11.133663 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-5ea4c831-cedc-4f53-a52f-294413f5cda1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:11.134272 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-5ea4c831-cedc-4f53-a52f-294413f5cda1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:11.148219 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ea4c831-cedc-4f53-a52f-294413f5cda1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:11.148921 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ea4c831-cedc-4f53-a52f-294413f5cda1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:11.149974 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ea4c831-cedc-4f53-a52f-294413f5cda1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:11.150557 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ea4c831-cedc-4f53-a52f-294413f5cda1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:11.463429 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-5ea4c831-cedc-4f53-a52f-294413f5cda1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:11.472716 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-5ea4c831-cedc-4f53-a52f-294413f5cda1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.344030 May 11 07:39:11.473225 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 55/106] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:11 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:12.490722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-fa015770-de3a-41d9-ab69-55e212082581 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:12.491575 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-fa015770-de3a-41d9-ab69-55e212082581 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:12.501679 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fa015770-de3a-41d9-ab69-55e212082581 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:12.502137 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fa015770-de3a-41d9-ab69-55e212082581 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:12.503072 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fa015770-de3a-41d9-ab69-55e212082581 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:12.503705 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fa015770-de3a-41d9-ab69-55e212082581 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:12.659655 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-fa015770-de3a-41d9-ab69-55e212082581 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:12.668450 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-fa015770-de3a-41d9-ab69-55e212082581 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.181917 May 11 07:39:12.669653 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 52/107] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:12 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:13.686779 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-cae6d535-c9c6-45a1-9841-4cc6b547836d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:13.687403 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-cae6d535-c9c6-45a1-9841-4cc6b547836d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:13.701359 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cae6d535-c9c6-45a1-9841-4cc6b547836d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:13.703020 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cae6d535-c9c6-45a1-9841-4cc6b547836d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:13.703930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cae6d535-c9c6-45a1-9841-4cc6b547836d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:13.704376 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cae6d535-c9c6-45a1-9841-4cc6b547836d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:13.839243 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-cae6d535-c9c6-45a1-9841-4cc6b547836d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:13.847018 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-cae6d535-c9c6-45a1-9841-4cc6b547836d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.165018 May 11 07:39:13.847592 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 56/108] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:13 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:14.864112 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3766f12d-8e08-44c2-9eac-362d6a725078 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:14.864894 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3766f12d-8e08-44c2-9eac-362d6a725078 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:14.871269 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3766f12d-8e08-44c2-9eac-362d6a725078 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:14.871733 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3766f12d-8e08-44c2-9eac-362d6a725078 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:14.872726 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3766f12d-8e08-44c2-9eac-362d6a725078 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:14.873335 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3766f12d-8e08-44c2-9eac-362d6a725078 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:15.065401 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3766f12d-8e08-44c2-9eac-362d6a725078 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:15.077766 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3766f12d-8e08-44c2-9eac-362d6a725078 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.216758 May 11 07:39:15.078729 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 53/109] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:14 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:15.828430 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3b82fd8f-e6df-47d6-b487-e1010d1c2760 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:15.829032 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-3b82fd8f-e6df-47d6-b487-e1010d1c2760 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:15.835285 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3b82fd8f-e6df-47d6-b487-e1010d1c2760 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:15.835732 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3b82fd8f-e6df-47d6-b487-e1010d1c2760 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:15.836489 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3b82fd8f-e6df-47d6-b487-e1010d1c2760 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:15.836929 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3b82fd8f-e6df-47d6-b487-e1010d1c2760 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:15.861033 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-3b82fd8f-e6df-47d6-b487-e1010d1c2760 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Going to try to terminate instance {{(pid=123599) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:39:15.949866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-3b82fd8f-e6df-47d6-b487-e1010d1c2760 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 204 len: 0 microversion: 2.1 time: 0.124790 May 11 07:39:15.950653 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 57/110] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:39:15 2022] DELETE /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:39:15.958499 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a5326dc7-25a5-4cd2-8d20-4223269b8e2e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:15.959114 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a5326dc7-25a5-4cd2-8d20-4223269b8e2e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:15.964836 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5326dc7-25a5-4cd2-8d20-4223269b8e2e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:15.965290 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5326dc7-25a5-4cd2-8d20-4223269b8e2e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:15.966110 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5326dc7-25a5-4cd2-8d20-4223269b8e2e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:15.966548 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5326dc7-25a5-4cd2-8d20-4223269b8e2e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:16.096566 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a87850d7-7548-4cb2-aee8-e4f2f9eb67a5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:16.097282 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a87850d7-7548-4cb2-aee8-e4f2f9eb67a5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:16.099801 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a5326dc7-25a5-4cd2-8d20-4223269b8e2e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:16.103244 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a87850d7-7548-4cb2-aee8-e4f2f9eb67a5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:16.103831 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a87850d7-7548-4cb2-aee8-e4f2f9eb67a5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:16.104706 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a87850d7-7548-4cb2-aee8-e4f2f9eb67a5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:16.105216 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a87850d7-7548-4cb2-aee8-e4f2f9eb67a5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:16.110614 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a5326dc7-25a5-4cd2-8d20-4223269b8e2e tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1553 microversion: 2.1 time: 0.155838 May 11 07:39:16.112975 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 54/111] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:15 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:16.248484 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a87850d7-7548-4cb2-aee8-e4f2f9eb67a5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:16.257097 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a87850d7-7548-4cb2-aee8-e4f2f9eb67a5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.166547 May 11 07:39:16.257700 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 58/112] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:16 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:39:17.127687 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-6f43a153-d6d2-4655-ac79-f78d45acd6cc tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:17.128295 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-6f43a153-d6d2-4655-ac79-f78d45acd6cc tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:17.134179 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6f43a153-d6d2-4655-ac79-f78d45acd6cc tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:17.134636 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6f43a153-d6d2-4655-ac79-f78d45acd6cc tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:17.135402 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6f43a153-d6d2-4655-ac79-f78d45acd6cc tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:17.135840 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6f43a153-d6d2-4655-ac79-f78d45acd6cc tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:17.259268 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-6f43a153-d6d2-4655-ac79-f78d45acd6cc tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:17.267046 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-6f43a153-d6d2-4655-ac79-f78d45acd6cc tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1553 microversion: 2.1 time: 0.143228 May 11 07:39:17.267608 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 55/113] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:17 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1553 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:17.275261 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-62dba031-c90b-4f97-b61f-dfc0bdc5b802 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:17.275859 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-62dba031-c90b-4f97-b61f-dfc0bdc5b802 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:17.282062 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-62dba031-c90b-4f97-b61f-dfc0bdc5b802 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:17.282506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-62dba031-c90b-4f97-b61f-dfc0bdc5b802 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:17.283257 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-62dba031-c90b-4f97-b61f-dfc0bdc5b802 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:17.283686 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-62dba031-c90b-4f97-b61f-dfc0bdc5b802 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:17.414223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-62dba031-c90b-4f97-b61f-dfc0bdc5b802 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:17.421920 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-62dba031-c90b-4f97-b61f-dfc0bdc5b802 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.150346 May 11 07:39:17.422481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 59/114] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:17 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:18.284640 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f4392d41-5639-40d7-a89a-d283763a8d4a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:18.285948 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f4392d41-5639-40d7-a89a-d283763a8d4a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:18.298681 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f4392d41-5639-40d7-a89a-d283763a8d4a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:18.299351 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f4392d41-5639-40d7-a89a-d283763a8d4a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:18.300336 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f4392d41-5639-40d7-a89a-d283763a8d4a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:18.300934 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f4392d41-5639-40d7-a89a-d283763a8d4a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:18.439102 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-76a03b1d-3703-44b3-bea0-5f68ff2ee0f3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:18.439705 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-76a03b1d-3703-44b3-bea0-5f68ff2ee0f3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:18.450762 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-76a03b1d-3703-44b3-bea0-5f68ff2ee0f3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:18.451213 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-76a03b1d-3703-44b3-bea0-5f68ff2ee0f3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:18.451988 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-76a03b1d-3703-44b3-bea0-5f68ff2ee0f3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:18.452416 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-76a03b1d-3703-44b3-bea0-5f68ff2ee0f3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:18.454382 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f4392d41-5639-40d7-a89a-d283763a8d4a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e948ae270457a8a9b6197f6a02394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac52de89f14d7995335a0d2c06ed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:18.471501 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f4392d41-5639-40d7-a89a-d283763a8d4a tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 200 len: 1511 microversion: 2.1 time: 0.190757 May 11 07:39:18.472094 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 56/115] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:18 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:39:18.491469 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-da432659-9760-4012-af90-1a50ded0a5d1 req-e1b659d4-b589-49d7-b6e3-648d4a1b8d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5fa53db-5b31-4554-8d58-560e0c4028b1", "name": "network-vif-deleted", "tag": "85426f35-70c3-4ad3-a864-509a1e6017ca"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:39:18.503954 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-da432659-9760-4012-af90-1a50ded0a5d1 req-e1b659d4-b589-49d7-b6e3-648d4a1b8d53 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:18.504439 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-da432659-9760-4012-af90-1a50ded0a5d1 req-e1b659d4-b589-49d7-b6e3-648d4a1b8d53 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:18.528277 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-da432659-9760-4012-af90-1a50ded0a5d1 req-e1b659d4-b589-49d7-b6e3-648d4a1b8d53 service nova] Creating event network-vif-deleted:85426f35-70c3-4ad3-a864-509a1e6017ca for instance a5fa53db-5b31-4554-8d58-560e0c4028b1 on hv-cinder-83699 May 11 07:39:18.534963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-da432659-9760-4012-af90-1a50ded0a5d1 req-e1b659d4-b589-49d7-b6e3-648d4a1b8d53 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048465 May 11 07:39:18.535684 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 57/116] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:39:18.644050 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-76a03b1d-3703-44b3-bea0-5f68ff2ee0f3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:18.652075 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-76a03b1d-3703-44b3-bea0-5f68ff2ee0f3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.217011 May 11 07:39:18.652636 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 60/117] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:18 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:39:19.491920 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-18f0f1a1-d045-428a-b65c-3b9edaa57060 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:19.492611 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-18f0f1a1-d045-428a-b65c-3b9edaa57060 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:19.500316 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-18f0f1a1-d045-428a-b65c-3b9edaa57060 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:19.500757 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-18f0f1a1-d045-428a-b65c-3b9edaa57060 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:19.501517 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-18f0f1a1-d045-428a-b65c-3b9edaa57060 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:19.501967 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-18f0f1a1-d045-428a-b65c-3b9edaa57060 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:19.517996 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-18f0f1a1-d045-428a-b65c-3b9edaa57060 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] HTTP exception thrown: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-18f0f1a1-d045-428a-b65c-3b9edaa57060 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Request method failure captured: May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 HTTP/1.1 May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2fvlHd_hZHJI44Lu_g91sXQ0CfhgBek9rtcSfRM4k0nd9vPV9HIymUogaIOyGuMpM4vpuwS9PspLp3FVdU4PJHzgPjXwSUn_mQBesvJWXbQIPeuWW6Ko_MrlUWVJDE1hUjKBtgioaFhajwm7RPmd2BUPOhJtq0id0nSSqL2ah7Lgds May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 96ac52de89f14d7995335a0d2c06ed8c May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-DeleteServersTestJSON-277777079 May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:39:19.522482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:39:19.524375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_96ac52de89f14d7995335a0d2c06ed8c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/96ac52de89f14d7995335a0d2c06ed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/96ac52de89f14d7995335a0d2c06ed8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/96ac52de89f14d7995335a0d2c06ed8c"}]}] May 11 07:39:19.524375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-DeleteServersTestJSON-277777079 May 11 07:39:19.524375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 96ac52de89f14d7995335a0d2c06ed8c May 11 07:39:19.524375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-DeleteServersTestJSON-277777079 May 11 07:39:19.524375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-DeleteServersTestJSON-277777079-project May 11 07:39:19.524375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:39:19.524375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:39:19.524375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: 3d8e948ae270457a8a9b6197f6a02394 May 11 07:39:19.524375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-DeleteServersTestJSON-277777079-project May 11 07:39:19.524375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:39:19.524375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:19.524375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': 'a5fa53db-5b31-4554-8d58-560e0c4028b1'} May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:39:19.525331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:19.526855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:39:19.529066 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-18f0f1a1-d045-428a-b65c-3b9edaa57060 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Returning 404 to user: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:39:19.529066 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-18f0f1a1-d045-428a-b65c-3b9edaa57060 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 404 len: 111 microversion: 2.1 time: 0.036081 May 11 07:39:19.529066 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 58/118] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:19 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:39:19.628081 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a68deb02-8422-45a9-a11f-e50364175a9f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:19.629133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a68deb02-8422-45a9-a11f-e50364175a9f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:19.635468 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a68deb02-8422-45a9-a11f-e50364175a9f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:19.635998 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a68deb02-8422-45a9-a11f-e50364175a9f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:19.636814 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a68deb02-8422-45a9-a11f-e50364175a9f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:19.637875 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a68deb02-8422-45a9-a11f-e50364175a9f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:19.650699 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-a68deb02-8422-45a9-a11f-e50364175a9f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] HTTP exception thrown: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a68deb02-8422-45a9-a11f-e50364175a9f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Request method failure captured: May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1/os-volume_attachments HTTP/1.1 May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2fvlHd_hZHJI44Lu_g91sXQ0CfhgBek9rtcSfRM4k0nd9vPV9HIymUogaIOyGuMpM4vpuwS9PspLp3FVdU4PJHzgPjXwSUn_mQBesvJWXbQIPeuWW6Ko_MrlUWVJDE1hUjKBtgioaFhajwm7RPmd2BUPOhJtq0id0nSSqL2ah7Lgds May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 96ac52de89f14d7995335a0d2c06ed8c May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-DeleteServersTestJSON-277777079 May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:39:19.655638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:39:19.656856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_96ac52de89f14d7995335a0d2c06ed8c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/96ac52de89f14d7995335a0d2c06ed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/96ac52de89f14d7995335a0d2c06ed8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/96ac52de89f14d7995335a0d2c06ed8c"}]}] May 11 07:39:19.656856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-DeleteServersTestJSON-277777079 May 11 07:39:19.656856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 96ac52de89f14d7995335a0d2c06ed8c May 11 07:39:19.656856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-DeleteServersTestJSON-277777079 May 11 07:39:19.656856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-DeleteServersTestJSON-277777079-project May 11 07:39:19.656856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:39:19.656856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:39:19.656856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: 3d8e948ae270457a8a9b6197f6a02394 May 11 07:39:19.656856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-DeleteServersTestJSON-277777079-project May 11 07:39:19.656856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:39:19.656856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:19.656856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'server_id': 'a5fa53db-5b31-4554-8d58-560e0c4028b1'} May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:39:19.657606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:19.658698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:19.659716 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a68deb02-8422-45a9-a11f-e50364175a9f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Returning 404 to user: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:39:19.659716 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a68deb02-8422-45a9-a11f-e50364175a9f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033448 May 11 07:39:19.659716 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 61/119] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:39:19 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:39:19.672196 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-6d887364-2490-49a5-ba3d-48ce4cdf63bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:19.672893 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-6d887364-2490-49a5-ba3d-48ce4cdf63bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:19.679532 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6d887364-2490-49a5-ba3d-48ce4cdf63bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:19.679919 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6d887364-2490-49a5-ba3d-48ce4cdf63bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:19.680730 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6d887364-2490-49a5-ba3d-48ce4cdf63bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:19.681123 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6d887364-2490-49a5-ba3d-48ce4cdf63bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:19.849432 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-6d887364-2490-49a5-ba3d-48ce4cdf63bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:19.857922 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-6d887364-2490-49a5-ba3d-48ce4cdf63bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.190613 May 11 07:39:19.858480 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 59/120] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:19 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:20.867368 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b9ca0fc8-0fd9-49eb-92f6-2c626a80d345 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:20.867992 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-b9ca0fc8-0fd9-49eb-92f6-2c626a80d345 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:20.874678 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b9ca0fc8-0fd9-49eb-92f6-2c626a80d345 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:20.874853 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-24ceffb2-2aed-4438-90b0-ca85e7114c2f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:20.875263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b9ca0fc8-0fd9-49eb-92f6-2c626a80d345 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:20.875425 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-24ceffb2-2aed-4438-90b0-ca85e7114c2f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:20.876090 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b9ca0fc8-0fd9-49eb-92f6-2c626a80d345 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:20.876533 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b9ca0fc8-0fd9-49eb-92f6-2c626a80d345 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:20.882429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-24ceffb2-2aed-4438-90b0-ca85e7114c2f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:20.883142 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-24ceffb2-2aed-4438-90b0-ca85e7114c2f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:20.884721 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-24ceffb2-2aed-4438-90b0-ca85e7114c2f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:20.885380 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-24ceffb2-2aed-4438-90b0-ca85e7114c2f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:20.893084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-b9ca0fc8-0fd9-49eb-92f6-2c626a80d345 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] HTTP exception thrown: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b9ca0fc8-0fd9-49eb-92f6-2c626a80d345 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Request method failure captured: May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: DELETE /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 HTTP/1.1 May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2fvlHd_hZHJI44Lu_g91sXQ0CfhgBek9rtcSfRM4k0nd9vPV9HIymUogaIOyGuMpM4vpuwS9PspLp3FVdU4PJHzgPjXwSUn_mQBesvJWXbQIPeuWW6Ko_MrlUWVJDE1hUjKBtgioaFhajwm7RPmd2BUPOhJtq0id0nSSqL2ah7Lgds May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 96ac52de89f14d7995335a0d2c06ed8c May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-DeleteServersTestJSON-277777079 May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:39:20.895947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:39:20.897116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_96ac52de89f14d7995335a0d2c06ed8c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/96ac52de89f14d7995335a0d2c06ed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/96ac52de89f14d7995335a0d2c06ed8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/96ac52de89f14d7995335a0d2c06ed8c"}]}] May 11 07:39:20.897116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-DeleteServersTestJSON-277777079 May 11 07:39:20.897116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 96ac52de89f14d7995335a0d2c06ed8c May 11 07:39:20.897116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-DeleteServersTestJSON-277777079 May 11 07:39:20.897116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-DeleteServersTestJSON-277777079-project May 11 07:39:20.897116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:39:20.897116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:39:20.897116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: 3d8e948ae270457a8a9b6197f6a02394 May 11 07:39:20.897116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-DeleteServersTestJSON-277777079-project May 11 07:39:20.897116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:39:20.897116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:20.897116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': 'a5fa53db-5b31-4554-8d58-560e0c4028b1'} May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:39:20.898371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:20.899894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:20.901180 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b9ca0fc8-0fd9-49eb-92f6-2c626a80d345 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Returning 404 to user: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:39:20.901180 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-b9ca0fc8-0fd9-49eb-92f6-2c626a80d345 tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 404 len: 111 microversion: 2.1 time: 0.034658 May 11 07:39:20.901180 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 62/121] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:39:20 2022] DELETE /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:39:20.907542 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b6c58065-83a6-4751-add2-4f5de6b2b07f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:20.908164 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-b6c58065-83a6-4751-add2-4f5de6b2b07f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] [instance: a5fa53db-5b31-4554-8d58-560e0c4028b1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:20.914072 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b6c58065-83a6-4751-add2-4f5de6b2b07f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:20.914524 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b6c58065-83a6-4751-add2-4f5de6b2b07f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:20.915711 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b6c58065-83a6-4751-add2-4f5de6b2b07f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:20.916306 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b6c58065-83a6-4751-add2-4f5de6b2b07f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:20.933168 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-b6c58065-83a6-4751-add2-4f5de6b2b07f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] HTTP exception thrown: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b6c58065-83a6-4751-add2-4f5de6b2b07f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Request method failure captured: May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 HTTP/1.1 May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2fvlHd_hZHJI44Lu_g91sXQ0CfhgBek9rtcSfRM4k0nd9vPV9HIymUogaIOyGuMpM4vpuwS9PspLp3FVdU4PJHzgPjXwSUn_mQBesvJWXbQIPeuWW6Ko_MrlUWVJDE1hUjKBtgioaFhajwm7RPmd2BUPOhJtq0id0nSSqL2ah7Lgds May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 96ac52de89f14d7995335a0d2c06ed8c May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-DeleteServersTestJSON-277777079 May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:39:20.935327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:39:20.936909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_96ac52de89f14d7995335a0d2c06ed8c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/96ac52de89f14d7995335a0d2c06ed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/96ac52de89f14d7995335a0d2c06ed8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/96ac52de89f14d7995335a0d2c06ed8c"}]}] May 11 07:39:20.936909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-DeleteServersTestJSON-277777079 May 11 07:39:20.936909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 96ac52de89f14d7995335a0d2c06ed8c May 11 07:39:20.936909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-DeleteServersTestJSON-277777079 May 11 07:39:20.936909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-DeleteServersTestJSON-277777079-project May 11 07:39:20.936909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:39:20.936909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:39:20.936909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: 3d8e948ae270457a8a9b6197f6a02394 May 11 07:39:20.936909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-DeleteServersTestJSON-277777079-project May 11 07:39:20.936909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:39:20.936909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:20.936909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': 'a5fa53db-5b31-4554-8d58-560e0c4028b1'} May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:39:20.937754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. May 11 07:39:20.939015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:39:20.944308 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b6c58065-83a6-4751-add2-4f5de6b2b07f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] Returning 404 to user: Instance a5fa53db-5b31-4554-8d58-560e0c4028b1 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:39:20.944308 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-b6c58065-83a6-4751-add2-4f5de6b2b07f tempest-DeleteServersTestJSON-277777079 tempest-DeleteServersTestJSON-277777079-project] 10.222.0.36 "GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1" status: 404 len: 111 microversion: 2.1 time: 0.036213 May 11 07:39:20.944308 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 63/122] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:20 2022] GET /compute/v2.1/servers/a5fa53db-5b31-4554-8d58-560e0c4028b1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:39:21.030442 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-24ceffb2-2aed-4438-90b0-ca85e7114c2f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:21.037810 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-24ceffb2-2aed-4438-90b0-ca85e7114c2f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.167359 May 11 07:39:21.038367 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 60/123] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:20 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:39:22.059437 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-60e49c71-7adb-4b77-84bc-0740cda78f3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:22.060683 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-60e49c71-7adb-4b77-84bc-0740cda78f3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:22.073124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-60e49c71-7adb-4b77-84bc-0740cda78f3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:22.074319 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-60e49c71-7adb-4b77-84bc-0740cda78f3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:22.075738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-60e49c71-7adb-4b77-84bc-0740cda78f3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:22.076276 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-60e49c71-7adb-4b77-84bc-0740cda78f3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:22.239423 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-60e49c71-7adb-4b77-84bc-0740cda78f3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:22.248490 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-60e49c71-7adb-4b77-84bc-0740cda78f3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.195496 May 11 07:39:22.251081 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 64/124] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:22 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:23.267261 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-fd185f30-b59b-4aaf-bf95-8f5e7cceca55 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:23.268447 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-fd185f30-b59b-4aaf-bf95-8f5e7cceca55 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:23.275943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fd185f30-b59b-4aaf-bf95-8f5e7cceca55 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:23.276604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fd185f30-b59b-4aaf-bf95-8f5e7cceca55 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:23.277679 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fd185f30-b59b-4aaf-bf95-8f5e7cceca55 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:23.278283 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fd185f30-b59b-4aaf-bf95-8f5e7cceca55 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:23.504492 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-fd185f30-b59b-4aaf-bf95-8f5e7cceca55 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:23.514118 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-fd185f30-b59b-4aaf-bf95-8f5e7cceca55 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.250228 May 11 07:39:23.515391 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 61/125] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:23 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:24.531805 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-87f85b3c-18c8-4817-a3c2-21664acff5ab tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:24.533017 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-87f85b3c-18c8-4817-a3c2-21664acff5ab tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:24.540450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-87f85b3c-18c8-4817-a3c2-21664acff5ab tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:24.541120 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-87f85b3c-18c8-4817-a3c2-21664acff5ab tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:24.542292 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-87f85b3c-18c8-4817-a3c2-21664acff5ab tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:24.542986 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-87f85b3c-18c8-4817-a3c2-21664acff5ab tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:24.780185 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-87f85b3c-18c8-4817-a3c2-21664acff5ab tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:24.789313 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-87f85b3c-18c8-4817-a3c2-21664acff5ab tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.261418 May 11 07:39:24.790239 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 65/126] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:24 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:39:25.806647 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-eba0ce33-83ba-459c-90de-4b95dd549b4f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:25.808048 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-eba0ce33-83ba-459c-90de-4b95dd549b4f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:25.814333 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-eba0ce33-83ba-459c-90de-4b95dd549b4f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:25.814785 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-eba0ce33-83ba-459c-90de-4b95dd549b4f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:25.815557 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-eba0ce33-83ba-459c-90de-4b95dd549b4f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:25.815992 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-eba0ce33-83ba-459c-90de-4b95dd549b4f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:26.046262 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-eba0ce33-83ba-459c-90de-4b95dd549b4f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:26.055132 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-eba0ce33-83ba-459c-90de-4b95dd549b4f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.252167 May 11 07:39:26.056302 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 62/127] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:25 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:27.075153 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2fef2067-0acc-487d-8065-30ab25d5f060 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:27.076439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2fef2067-0acc-487d-8065-30ab25d5f060 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:27.083825 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2fef2067-0acc-487d-8065-30ab25d5f060 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:27.084592 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2fef2067-0acc-487d-8065-30ab25d5f060 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:27.085708 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2fef2067-0acc-487d-8065-30ab25d5f060 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:27.086365 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2fef2067-0acc-487d-8065-30ab25d5f060 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:27.366061 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2fef2067-0acc-487d-8065-30ab25d5f060 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:27.375502 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2fef2067-0acc-487d-8065-30ab25d5f060 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.305141 May 11 07:39:27.386445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 66/128] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:27 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:28.394045 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a5c79eb8-293b-4622-a132-e2573269201c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:28.395303 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a5c79eb8-293b-4622-a132-e2573269201c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:28.401753 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5c79eb8-293b-4622-a132-e2573269201c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:28.402471 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5c79eb8-293b-4622-a132-e2573269201c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:28.403705 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5c79eb8-293b-4622-a132-e2573269201c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:28.404356 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5c79eb8-293b-4622-a132-e2573269201c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:28.606748 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a5c79eb8-293b-4622-a132-e2573269201c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:28.616762 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a5c79eb8-293b-4622-a132-e2573269201c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.226480 May 11 07:39:28.617696 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 63/129] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:28 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:28.635128 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-96b9fe12-a9c5-4489-9e10-fce95327fc95 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Action: 'create', calling method: .version_select at 0x7f19ecbacca0>, body: {"keypair": {"name": "tempest-keypair-566401466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCowyXMaqaIysLn5nmymiuSamGamlEM5F916LtZJY5yQ9CHtFs+ZUZuZfO+ifppDB3THcBEUvhUFA2ekdpA8BLWdRyvQ2CsIC+Rt/DiJR9I4IrQk/FxzRbOcYTyARcwog=="}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:39:28.654680 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-96b9fe12-a9c5-4489-9e10-fce95327fc95 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Getting quotas for project 9750cb9309234cb1b63343050ba700f9. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:39:28.658715 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-96b9fe12-a9c5-4489-9e10-fce95327fc95 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Getting quotas for user ad7271d8e9424bb7ad8ce1143fc71de9 and project 9750cb9309234cb1b63343050ba700f9. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:39:28.692414 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-96b9fe12-a9c5-4489-9e10-fce95327fc95 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.301210 May 11 07:39:28.693510 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 67/130] 10.222.0.36 () {60 vars in 1158 bytes} [Wed May 11 07:39:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:39:29.640560 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2e2610f1-d7f1-424c-93b6-d475a9577a65 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:29.641085 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2e2610f1-d7f1-424c-93b6-d475a9577a65 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:29.654109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2e2610f1-d7f1-424c-93b6-d475a9577a65 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:29.654552 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2e2610f1-d7f1-424c-93b6-d475a9577a65 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:29.662987 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2e2610f1-d7f1-424c-93b6-d475a9577a65 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:29.663434 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2e2610f1-d7f1-424c-93b6-d475a9577a65 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:30.185775 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-2e2610f1-d7f1-424c-93b6-d475a9577a65 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:30.199229 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2e2610f1-d7f1-424c-93b6-d475a9577a65 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.568319 May 11 07:39:30.203833 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 64/131] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:29 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:31.134534 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-538389568", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e16a8a2-6e6f-43bc-8406-954bb2e1bbba"}], "security_groups": [{"name": "tempest-securitygroup--385245158"}], "key_name": "tempest-keypair-566401466", "user_data": "}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:39:31.225840 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ff4b2919-856c-44fc-8b09-3f58f4b6d049 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:31.227816 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-ff4b2919-856c-44fc-8b09-3f58f4b6d049 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:31.238597 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ff4b2919-856c-44fc-8b09-3f58f4b6d049 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:31.239307 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ff4b2919-856c-44fc-8b09-3f58f4b6d049 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:31.241779 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ff4b2919-856c-44fc-8b09-3f58f4b6d049 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:31.242565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ff4b2919-856c-44fc-8b09-3f58f4b6d049 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:31.250767 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.network.neutron [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] validate_networks() for [('3e16a8a2-6e6f-43bc-8406-954bb2e1bbba', None, None, None, None, None)] {{(pid=123599) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:39:31.473466 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-ff4b2919-856c-44fc-8b09-3f58f4b6d049 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:31.482354 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-ff4b2919-856c-44fc-8b09-3f58f4b6d049 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.265747 May 11 07:39:31.483658 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 65/132] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:31 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:31.818866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Flavor limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:39:31.819279 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Image limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:39:31.819994 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Flavor pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:39:31.820482 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Image pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:39:31.820857 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:39:31.830538 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:31.831383 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:31.832865 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:31.834002 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:31.851673 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Getting quotas for project 9750cb9309234cb1b63343050ba700f9. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:39:31.856700 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Getting quotas for user ad7271d8e9424bb7ad8ce1143fc71de9 and project 9750cb9309234cb1b63343050ba700f9. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:39:31.868527 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Going to run 1 instances... {{(pid=123599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:39:31.870845 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:39:31.925520 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-123bf513-1601-465f-899e-585ace47ea66 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.795495 May 11 07:39:31.927328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 68/133] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:39:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:39:31.936925 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-31192572-3a73-4192-8ec3-475be5209f02 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:31.937532 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-31192572-3a73-4192-8ec3-475be5209f02 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:32.014281 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-31192572-3a73-4192-8ec3-475be5209f02 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:32.022540 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-31192572-3a73-4192-8ec3-475be5209f02 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1236 microversion: 2.1 time: 0.088918 May 11 07:39:32.032560 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 66/134] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:31 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1236 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:32.501892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d4821d89-e7cf-42c2-926d-4d4c94511615 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:32.512946 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d4821d89-e7cf-42c2-926d-4d4c94511615 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:32.525199 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4821d89-e7cf-42c2-926d-4d4c94511615 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:32.525698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4821d89-e7cf-42c2-926d-4d4c94511615 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:32.526713 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4821d89-e7cf-42c2-926d-4d4c94511615 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:32.527151 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4821d89-e7cf-42c2-926d-4d4c94511615 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:32.791340 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d4821d89-e7cf-42c2-926d-4d4c94511615 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:32.799711 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d4821d89-e7cf-42c2-926d-4d4c94511615 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.304322 May 11 07:39:32.804763 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 69/135] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:32 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:33.040514 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f99667b7-0e3c-4da1-b095-504f3920c183 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:33.042509 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f99667b7-0e3c-4da1-b095-504f3920c183 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:33.051628 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f99667b7-0e3c-4da1-b095-504f3920c183 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:33.052267 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f99667b7-0e3c-4da1-b095-504f3920c183 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:33.053433 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f99667b7-0e3c-4da1-b095-504f3920c183 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:33.054520 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f99667b7-0e3c-4da1-b095-504f3920c183 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:33.180561 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f99667b7-0e3c-4da1-b095-504f3920c183 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:33.203004 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f99667b7-0e3c-4da1-b095-504f3920c183 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1288 microversion: 2.1 time: 0.166255 May 11 07:39:33.206585 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 67/136] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:33 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1288 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:33.822733 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d3f6c3f3-7f51-4d55-b55c-2a79f11ba955 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:33.823335 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d3f6c3f3-7f51-4d55-b55c-2a79f11ba955 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:33.831434 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d3f6c3f3-7f51-4d55-b55c-2a79f11ba955 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:33.831888 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d3f6c3f3-7f51-4d55-b55c-2a79f11ba955 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:33.833239 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d3f6c3f3-7f51-4d55-b55c-2a79f11ba955 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:33.834281 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d3f6c3f3-7f51-4d55-b55c-2a79f11ba955 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:34.031695 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d3f6c3f3-7f51-4d55-b55c-2a79f11ba955 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:34.041486 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d3f6c3f3-7f51-4d55-b55c-2a79f11ba955 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.223719 May 11 07:39:34.042714 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 70/137] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:33 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:34.228958 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-399f10f5-7a23-4cf8-ab7f-343d5d2939ed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:34.231840 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-399f10f5-7a23-4cf8-ab7f-343d5d2939ed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:34.241967 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-399f10f5-7a23-4cf8-ab7f-343d5d2939ed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:34.243596 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-399f10f5-7a23-4cf8-ab7f-343d5d2939ed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:34.245941 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-399f10f5-7a23-4cf8-ab7f-343d5d2939ed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:34.247162 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-399f10f5-7a23-4cf8-ab7f-343d5d2939ed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:34.360720 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-399f10f5-7a23-4cf8-ab7f-343d5d2939ed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:34.375682 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-399f10f5-7a23-4cf8-ab7f-343d5d2939ed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1294 microversion: 2.1 time: 0.150884 May 11 07:39:34.376432 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 68/138] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:34 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1294 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:35.057711 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-cc28b9d8-90a5-403f-a254-b8c5388ec682 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:35.058324 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-cc28b9d8-90a5-403f-a254-b8c5388ec682 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:35.065011 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cc28b9d8-90a5-403f-a254-b8c5388ec682 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:35.065742 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cc28b9d8-90a5-403f-a254-b8c5388ec682 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:35.067436 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cc28b9d8-90a5-403f-a254-b8c5388ec682 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:35.068048 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cc28b9d8-90a5-403f-a254-b8c5388ec682 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:35.269265 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-cc28b9d8-90a5-403f-a254-b8c5388ec682 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:35.279871 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-cc28b9d8-90a5-403f-a254-b8c5388ec682 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.225760 May 11 07:39:35.281138 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 71/139] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:35 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:35.393564 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c2ec06de-2d1e-4ef0-8ceb-caf2aa527ee4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:35.394158 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c2ec06de-2d1e-4ef0-8ceb-caf2aa527ee4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:35.401165 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c2ec06de-2d1e-4ef0-8ceb-caf2aa527ee4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:35.403318 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c2ec06de-2d1e-4ef0-8ceb-caf2aa527ee4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:35.405639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c2ec06de-2d1e-4ef0-8ceb-caf2aa527ee4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:35.406789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c2ec06de-2d1e-4ef0-8ceb-caf2aa527ee4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:35.647600 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c2ec06de-2d1e-4ef0-8ceb-caf2aa527ee4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:35.656889 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c2ec06de-2d1e-4ef0-8ceb-caf2aa527ee4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1361 microversion: 2.1 time: 0.266912 May 11 07:39:35.677032 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 69/140] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:35 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1361 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:35.781310 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-8262d364-0632-497c-9eec-66954cf046ba req-8e582a08-2a21-4289-a4e6-b2fca2aa22a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e62bda3-ed20-4c7e-a3c8-aa90f6f79937", "tag": "95cc9cfe-62b1-4c76-8e8f-f82e3b55dada"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:39:35.809608 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-8262d364-0632-497c-9eec-66954cf046ba req-8e582a08-2a21-4289-a4e6-b2fca2aa22a6 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:35.810286 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-8262d364-0632-497c-9eec-66954cf046ba req-8e582a08-2a21-4289-a4e6-b2fca2aa22a6 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:35.830854 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-8262d364-0632-497c-9eec-66954cf046ba req-8e582a08-2a21-4289-a4e6-b2fca2aa22a6 service nova] Creating event network-changed:95cc9cfe-62b1-4c76-8e8f-f82e3b55dada for instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 on hv-cinder-83699 May 11 07:39:35.850804 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-8262d364-0632-497c-9eec-66954cf046ba req-8e582a08-2a21-4289-a4e6-b2fca2aa22a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077001 May 11 07:39:35.869221 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 72/141] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:39:36.298718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f1f94d97-8b0f-449e-a650-66f3e3a03375 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:36.299337 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f1f94d97-8b0f-449e-a650-66f3e3a03375 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:36.308764 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f1f94d97-8b0f-449e-a650-66f3e3a03375 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:36.310238 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f1f94d97-8b0f-449e-a650-66f3e3a03375 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:36.311789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f1f94d97-8b0f-449e-a650-66f3e3a03375 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:36.312429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f1f94d97-8b0f-449e-a650-66f3e3a03375 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:36.596901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f1f94d97-8b0f-449e-a650-66f3e3a03375 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:36.605684 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f1f94d97-8b0f-449e-a650-66f3e3a03375 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.311447 May 11 07:39:36.606258 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 70/142] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:36 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:36.674724 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2e2b588f-497d-45e8-b332-9e919a5b4d81 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:36.675406 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2e2b588f-497d-45e8-b332-9e919a5b4d81 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:36.682437 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2e2b588f-497d-45e8-b332-9e919a5b4d81 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:36.682879 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2e2b588f-497d-45e8-b332-9e919a5b4d81 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:36.684156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2e2b588f-497d-45e8-b332-9e919a5b4d81 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:36.684584 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2e2b588f-497d-45e8-b332-9e919a5b4d81 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:36.821713 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2e2b588f-497d-45e8-b332-9e919a5b4d81 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:36.829215 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2e2b588f-497d-45e8-b332-9e919a5b4d81 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1361 microversion: 2.1 time: 0.158689 May 11 07:39:36.829921 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 73/143] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:36 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:37.622077 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-59781c1c-acad-4459-b42d-a07f4eee99ca tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:37.622870 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-59781c1c-acad-4459-b42d-a07f4eee99ca tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:37.629111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-59781c1c-acad-4459-b42d-a07f4eee99ca tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:37.629578 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-59781c1c-acad-4459-b42d-a07f4eee99ca tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:37.630346 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-59781c1c-acad-4459-b42d-a07f4eee99ca tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:37.630782 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-59781c1c-acad-4459-b42d-a07f4eee99ca tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:37.773791 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-59781c1c-acad-4459-b42d-a07f4eee99ca tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:37.781807 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-59781c1c-acad-4459-b42d-a07f4eee99ca tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.163530 May 11 07:39:37.782378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 71/144] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:37 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:39:37.846768 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0681ec0a-8d3b-40ad-b455-90472198420b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:37.847296 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0681ec0a-8d3b-40ad-b455-90472198420b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:37.853606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0681ec0a-8d3b-40ad-b455-90472198420b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:37.854054 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0681ec0a-8d3b-40ad-b455-90472198420b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:37.854811 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0681ec0a-8d3b-40ad-b455-90472198420b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:37.855274 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0681ec0a-8d3b-40ad-b455-90472198420b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:37.980512 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0681ec0a-8d3b-40ad-b455-90472198420b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:37.987665 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0681ec0a-8d3b-40ad-b455-90472198420b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1361 microversion: 2.1 time: 0.144789 May 11 07:39:37.988223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 74/145] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:37 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1361 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:38.799134 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-93d24f20-b9d8-499c-88d5-16ca665bf0d9 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:38.799668 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-93d24f20-b9d8-499c-88d5-16ca665bf0d9 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:38.805493 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-93d24f20-b9d8-499c-88d5-16ca665bf0d9 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:38.805967 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-93d24f20-b9d8-499c-88d5-16ca665bf0d9 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:38.806714 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-93d24f20-b9d8-499c-88d5-16ca665bf0d9 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:38.807141 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-93d24f20-b9d8-499c-88d5-16ca665bf0d9 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:38.950120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-93d24f20-b9d8-499c-88d5-16ca665bf0d9 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:38.957340 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-93d24f20-b9d8-499c-88d5-16ca665bf0d9 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.162035 May 11 07:39:38.957927 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 72/146] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:38 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:39.004679 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-35fa100d-dfbe-4b58-8be8-62433ba83da8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:39.005291 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-35fa100d-dfbe-4b58-8be8-62433ba83da8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:39.012041 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-35fa100d-dfbe-4b58-8be8-62433ba83da8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:39.012488 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-35fa100d-dfbe-4b58-8be8-62433ba83da8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:39.013259 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-35fa100d-dfbe-4b58-8be8-62433ba83da8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:39.013808 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-35fa100d-dfbe-4b58-8be8-62433ba83da8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:39.141362 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-35fa100d-dfbe-4b58-8be8-62433ba83da8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:39.148825 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-35fa100d-dfbe-4b58-8be8-62433ba83da8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1361 microversion: 2.1 time: 0.147897 May 11 07:39:39.149424 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 75/147] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:38 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:39.975427 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-6a13a32f-3f8f-429c-b409-31bc3d943e7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:39.976726 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-6a13a32f-3f8f-429c-b409-31bc3d943e7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:39.984864 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6a13a32f-3f8f-429c-b409-31bc3d943e7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:39.990046 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6a13a32f-3f8f-429c-b409-31bc3d943e7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:39.991006 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6a13a32f-3f8f-429c-b409-31bc3d943e7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:39.991544 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6a13a32f-3f8f-429c-b409-31bc3d943e7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:40.168627 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-75cbda82-6137-4611-b1b5-9301d9deee92 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:40.170308 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-75cbda82-6137-4611-b1b5-9301d9deee92 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:40.186087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-75cbda82-6137-4611-b1b5-9301d9deee92 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:40.186776 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-75cbda82-6137-4611-b1b5-9301d9deee92 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:40.188285 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-75cbda82-6137-4611-b1b5-9301d9deee92 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:40.189166 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-75cbda82-6137-4611-b1b5-9301d9deee92 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:40.195273 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-6a13a32f-3f8f-429c-b409-31bc3d943e7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:40.204289 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-6a13a32f-3f8f-429c-b409-31bc3d943e7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.233553 May 11 07:39:40.204863 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 73/148] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:39 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:40.350149 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-75cbda82-6137-4611-b1b5-9301d9deee92 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:40.358300 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-75cbda82-6137-4611-b1b5-9301d9deee92 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1361 microversion: 2.1 time: 0.195173 May 11 07:39:40.358859 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 76/149] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:40 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:41.222015 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5856dd1b-72b8-4cd9-87b1-5586e0d924a3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:41.222554 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-5856dd1b-72b8-4cd9-87b1-5586e0d924a3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:41.229116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5856dd1b-72b8-4cd9-87b1-5586e0d924a3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:41.229582 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5856dd1b-72b8-4cd9-87b1-5586e0d924a3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:41.230629 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5856dd1b-72b8-4cd9-87b1-5586e0d924a3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:41.231928 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5856dd1b-72b8-4cd9-87b1-5586e0d924a3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:41.360243 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-5856dd1b-72b8-4cd9-87b1-5586e0d924a3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:41.367696 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-5856dd1b-72b8-4cd9-87b1-5586e0d924a3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.149809 May 11 07:39:41.368332 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 74/150] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:41 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:41.375650 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-1bec6516-c0b0-4cf8-a287-79cc2827b963 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:41.376383 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-1bec6516-c0b0-4cf8-a287-79cc2827b963 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:41.382636 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1bec6516-c0b0-4cf8-a287-79cc2827b963 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:41.383090 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1bec6516-c0b0-4cf8-a287-79cc2827b963 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:41.383848 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1bec6516-c0b0-4cf8-a287-79cc2827b963 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:41.384282 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1bec6516-c0b0-4cf8-a287-79cc2827b963 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:41.519512 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-1bec6516-c0b0-4cf8-a287-79cc2827b963 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:41.527051 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-1bec6516-c0b0-4cf8-a287-79cc2827b963 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1361 microversion: 2.1 time: 0.155706 May 11 07:39:41.527618 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 77/151] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:41 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:42.383881 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3f9206da-d7c0-4d4b-87b3-1648f9a56a10 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:42.384489 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3f9206da-d7c0-4d4b-87b3-1648f9a56a10 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:42.390377 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3f9206da-d7c0-4d4b-87b3-1648f9a56a10 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:42.390813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3f9206da-d7c0-4d4b-87b3-1648f9a56a10 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:42.391566 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3f9206da-d7c0-4d4b-87b3-1648f9a56a10 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:42.392000 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3f9206da-d7c0-4d4b-87b3-1648f9a56a10 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:42.515353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3f9206da-d7c0-4d4b-87b3-1648f9a56a10 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:42.522557 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3f9206da-d7c0-4d4b-87b3-1648f9a56a10 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.142452 May 11 07:39:42.523108 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 75/152] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:42 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:42.544418 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-cfe8b80f-f896-46c3-8da5-da7bac90a534 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:42.545026 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-cfe8b80f-f896-46c3-8da5-da7bac90a534 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:42.553559 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cfe8b80f-f896-46c3-8da5-da7bac90a534 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:42.554014 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cfe8b80f-f896-46c3-8da5-da7bac90a534 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:42.554796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cfe8b80f-f896-46c3-8da5-da7bac90a534 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:42.555230 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cfe8b80f-f896-46c3-8da5-da7bac90a534 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:42.680680 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-cfe8b80f-f896-46c3-8da5-da7bac90a534 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:42.690414 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-cfe8b80f-f896-46c3-8da5-da7bac90a534 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1361 microversion: 2.1 time: 0.150003 May 11 07:39:42.691659 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 78/153] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:42 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:43.539890 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e099e542-8158-4dfe-8fba-bab57e2b8b52 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:43.540417 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e099e542-8158-4dfe-8fba-bab57e2b8b52 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:43.546565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e099e542-8158-4dfe-8fba-bab57e2b8b52 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:43.547014 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e099e542-8158-4dfe-8fba-bab57e2b8b52 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:43.547781 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e099e542-8158-4dfe-8fba-bab57e2b8b52 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:43.548214 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e099e542-8158-4dfe-8fba-bab57e2b8b52 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:43.688435 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e099e542-8158-4dfe-8fba-bab57e2b8b52 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:43.698480 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e099e542-8158-4dfe-8fba-bab57e2b8b52 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.162477 May 11 07:39:43.699043 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 76/154] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:43 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:43.708227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7e680635-17ad-485e-931c-446c0e79e903 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:43.709628 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-7e680635-17ad-485e-931c-446c0e79e903 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:43.717327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7e680635-17ad-485e-931c-446c0e79e903 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:43.717800 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7e680635-17ad-485e-931c-446c0e79e903 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:43.718578 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7e680635-17ad-485e-931c-446c0e79e903 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:43.719013 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7e680635-17ad-485e-931c-446c0e79e903 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:44.233420 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-7e680635-17ad-485e-931c-446c0e79e903 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:44.242699 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-7e680635-17ad-485e-931c-446c0e79e903 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1361 microversion: 2.1 time: 0.538144 May 11 07:39:44.243316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 79/155] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:43 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1361 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:44.716709 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2246b429-e009-484d-955d-e31c0d6990a1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:44.717310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2246b429-e009-484d-955d-e31c0d6990a1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:44.723341 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2246b429-e009-484d-955d-e31c0d6990a1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:44.723789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2246b429-e009-484d-955d-e31c0d6990a1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:44.724543 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2246b429-e009-484d-955d-e31c0d6990a1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:44.724975 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2246b429-e009-484d-955d-e31c0d6990a1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:44.855576 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-2246b429-e009-484d-955d-e31c0d6990a1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:44.864908 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2246b429-e009-484d-955d-e31c0d6990a1 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.152701 May 11 07:39:44.865488 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 77/156] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:44 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:45.260862 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6ffd80d5-2e11-4267-b5cc-4fbcf17c11d8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:45.261463 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-6ffd80d5-2e11-4267-b5cc-4fbcf17c11d8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:45.273252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6ffd80d5-2e11-4267-b5cc-4fbcf17c11d8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:45.274425 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6ffd80d5-2e11-4267-b5cc-4fbcf17c11d8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:45.275472 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6ffd80d5-2e11-4267-b5cc-4fbcf17c11d8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:45.276211 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6ffd80d5-2e11-4267-b5cc-4fbcf17c11d8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:45.423863 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-6ffd80d5-2e11-4267-b5cc-4fbcf17c11d8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:45.431494 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-6ffd80d5-2e11-4267-b5cc-4fbcf17c11d8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1361 microversion: 2.1 time: 0.175373 May 11 07:39:45.432059 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 80/157] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:45 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:39:45.882247 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c666f83c-484a-43fb-b048-963a2feaaa0a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:45.882874 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c666f83c-484a-43fb-b048-963a2feaaa0a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:45.889329 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c666f83c-484a-43fb-b048-963a2feaaa0a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:45.889806 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c666f83c-484a-43fb-b048-963a2feaaa0a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:45.890729 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c666f83c-484a-43fb-b048-963a2feaaa0a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:45.891163 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c666f83c-484a-43fb-b048-963a2feaaa0a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:46.069176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c666f83c-484a-43fb-b048-963a2feaaa0a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:46.077488 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c666f83c-484a-43fb-b048-963a2feaaa0a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.199033 May 11 07:39:46.078120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 78/158] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:45 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:46.450531 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-4792bad7-7a5f-4810-b305-a9b4ccb4989b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:46.451146 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-4792bad7-7a5f-4810-b305-a9b4ccb4989b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:46.467478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4792bad7-7a5f-4810-b305-a9b4ccb4989b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:46.467930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4792bad7-7a5f-4810-b305-a9b4ccb4989b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:46.468730 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4792bad7-7a5f-4810-b305-a9b4ccb4989b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:46.469166 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4792bad7-7a5f-4810-b305-a9b4ccb4989b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:46.609735 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-4792bad7-7a5f-4810-b305-a9b4ccb4989b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:46.616803 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-4792bad7-7a5f-4810-b305-a9b4ccb4989b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1361 microversion: 2.1 time: 0.170881 May 11 07:39:46.617368 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 81/159] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:46 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:47.095093 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-826cd8ce-a516-43e6-9afa-b4d286e45a22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:47.095808 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-826cd8ce-a516-43e6-9afa-b4d286e45a22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:47.102284 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-826cd8ce-a516-43e6-9afa-b4d286e45a22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:47.102733 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-826cd8ce-a516-43e6-9afa-b4d286e45a22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:47.103581 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-826cd8ce-a516-43e6-9afa-b4d286e45a22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:47.104006 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-826cd8ce-a516-43e6-9afa-b4d286e45a22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:47.245596 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-826cd8ce-a516-43e6-9afa-b4d286e45a22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:47.254056 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-826cd8ce-a516-43e6-9afa-b4d286e45a22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.162978 May 11 07:39:47.254621 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 79/160] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:47 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:47.634305 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-822ba6f8-6494-42aa-adfa-1005de123043 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:47.634948 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-822ba6f8-6494-42aa-adfa-1005de123043 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:47.641901 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-822ba6f8-6494-42aa-adfa-1005de123043 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:47.642352 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-822ba6f8-6494-42aa-adfa-1005de123043 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:47.643378 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-822ba6f8-6494-42aa-adfa-1005de123043 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:47.644025 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-822ba6f8-6494-42aa-adfa-1005de123043 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:47.778257 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-822ba6f8-6494-42aa-adfa-1005de123043 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:47.787079 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-822ba6f8-6494-42aa-adfa-1005de123043 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1361 microversion: 2.1 time: 0.156583 May 11 07:39:47.787817 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 82/161] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:47 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:48.217336 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-6684702a-561e-4316-b4bd-a1745bb5ea2e req-760b739a-9026-4692-885e-6132ecaf3d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e62bda3-ed20-4c7e-a3c8-aa90f6f79937", "name": "network-vif-plugged", "status": "completed", "tag": "95cc9cfe-62b1-4c76-8e8f-f82e3b55dada"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:39:48.225691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-6684702a-561e-4316-b4bd-a1745bb5ea2e req-760b739a-9026-4692-885e-6132ecaf3d5a service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:48.226124 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-6684702a-561e-4316-b4bd-a1745bb5ea2e req-760b739a-9026-4692-885e-6132ecaf3d5a service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:48.244306 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-6684702a-561e-4316-b4bd-a1745bb5ea2e req-760b739a-9026-4692-885e-6132ecaf3d5a service nova] Creating event network-vif-plugged:95cc9cfe-62b1-4c76-8e8f-f82e3b55dada for instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 on hv-cinder-83699 May 11 07:39:48.249866 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-6684702a-561e-4316-b4bd-a1745bb5ea2e req-760b739a-9026-4692-885e-6132ecaf3d5a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036636 May 11 07:39:48.251261 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 80/162] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:39:48.271345 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-9da7d886-4132-4840-b525-2ba7871c89d8 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:48.271950 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-9da7d886-4132-4840-b525-2ba7871c89d8 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:48.278725 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9da7d886-4132-4840-b525-2ba7871c89d8 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:48.279271 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9da7d886-4132-4840-b525-2ba7871c89d8 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:48.280103 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9da7d886-4132-4840-b525-2ba7871c89d8 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:48.280816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9da7d886-4132-4840-b525-2ba7871c89d8 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:48.608979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-9da7d886-4132-4840-b525-2ba7871c89d8 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:48.641312 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-9da7d886-4132-4840-b525-2ba7871c89d8 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1522 microversion: 2.1 time: 0.367741 May 11 07:39:48.642813 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 83/163] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:48 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:48.806247 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-380252ba-30ad-4371-b15d-a8e9ec3215d4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:48.807852 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-380252ba-30ad-4371-b15d-a8e9ec3215d4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:48.824112 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-380252ba-30ad-4371-b15d-a8e9ec3215d4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:48.825471 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-380252ba-30ad-4371-b15d-a8e9ec3215d4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:48.826582 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-380252ba-30ad-4371-b15d-a8e9ec3215d4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:48.827848 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-380252ba-30ad-4371-b15d-a8e9ec3215d4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:49.038036 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-380252ba-30ad-4371-b15d-a8e9ec3215d4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:49.047001 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-380252ba-30ad-4371-b15d-a8e9ec3215d4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1361 microversion: 2.1 time: 0.246283 May 11 07:39:49.047567 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 81/164] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:48 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:39:49.659883 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-396d81dd-f4f4-4a7b-8780-ade78d98e048 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:49.661404 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-396d81dd-f4f4-4a7b-8780-ade78d98e048 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:49.670055 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-396d81dd-f4f4-4a7b-8780-ade78d98e048 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:49.670735 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-396d81dd-f4f4-4a7b-8780-ade78d98e048 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:49.672358 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-396d81dd-f4f4-4a7b-8780-ade78d98e048 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:49.672985 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-396d81dd-f4f4-4a7b-8780-ade78d98e048 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:49.912859 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-396d81dd-f4f4-4a7b-8780-ade78d98e048 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:49.924639 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-396d81dd-f4f4-4a7b-8780-ade78d98e048 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1502 microversion: 2.1 time: 0.268783 May 11 07:39:49.925947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 84/165] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:49 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1502 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:49.942811 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a87a758b-2a1e-412d-9efd-f72d17d84c5a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:49.943313 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a87a758b-2a1e-412d-9efd-f72d17d84c5a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:49.951483 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a87a758b-2a1e-412d-9efd-f72d17d84c5a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:49.951936 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a87a758b-2a1e-412d-9efd-f72d17d84c5a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:49.952718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a87a758b-2a1e-412d-9efd-f72d17d84c5a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:49.954190 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a87a758b-2a1e-412d-9efd-f72d17d84c5a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:50.064450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-41d967d7-36b9-4f2e-a045-41bd689dc28b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:50.065046 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-41d967d7-36b9-4f2e-a045-41bd689dc28b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:50.077313 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-41d967d7-36b9-4f2e-a045-41bd689dc28b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:50.078027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-41d967d7-36b9-4f2e-a045-41bd689dc28b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:50.078996 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-41d967d7-36b9-4f2e-a045-41bd689dc28b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:50.079614 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-41d967d7-36b9-4f2e-a045-41bd689dc28b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:50.246084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a87a758b-2a1e-412d-9efd-f72d17d84c5a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:50.253440 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a87a758b-2a1e-412d-9efd-f72d17d84c5a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1515 microversion: 2.1 time: 0.314749 May 11 07:39:50.254361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 82/166] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:49 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1515 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:50.327740 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-41d967d7-36b9-4f2e-a045-41bd689dc28b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:50.337034 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-41d967d7-36b9-4f2e-a045-41bd689dc28b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1361 microversion: 2.1 time: 0.276360 May 11 07:39:50.348117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 85/167] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:50 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1361 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:51.356685 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-27162922-3c3e-4974-a946-6cf355a2ae2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:51.357895 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-27162922-3c3e-4974-a946-6cf355a2ae2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:51.364934 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-27162922-3c3e-4974-a946-6cf355a2ae2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:51.365465 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-27162922-3c3e-4974-a946-6cf355a2ae2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:51.366664 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-27162922-3c3e-4974-a946-6cf355a2ae2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:51.367333 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-27162922-3c3e-4974-a946-6cf355a2ae2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:51.544935 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-27162922-3c3e-4974-a946-6cf355a2ae2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:51.553679 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-27162922-3c3e-4974-a946-6cf355a2ae2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1546 microversion: 2.1 time: 0.202147 May 11 07:39:51.554787 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 83/168] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:51 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1546 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:51.571062 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-1a8cc940-a49c-4e9a-b0bd-32674d4c2b30 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:51.571612 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-1a8cc940-a49c-4e9a-b0bd-32674d4c2b30 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:51.578995 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1a8cc940-a49c-4e9a-b0bd-32674d4c2b30 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:51.579451 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1a8cc940-a49c-4e9a-b0bd-32674d4c2b30 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:51.580214 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1a8cc940-a49c-4e9a-b0bd-32674d4c2b30 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:51.580649 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1a8cc940-a49c-4e9a-b0bd-32674d4c2b30 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:51.676490 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-1a8cc940-a49c-4e9a-b0bd-32674d4c2b30 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109160 May 11 07:39:51.677525 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 86/169] 10.222.0.36 () {58 vars in 1274 bytes} [Wed May 11 07:39:51 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:39:51.681754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8191e0a7-2b5e-4b25-ad18-699669edca3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:39:51.681754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8191e0a7-2b5e-4b25-ad18-699669edca3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:51.686566 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8191e0a7-2b5e-4b25-ad18-699669edca3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:51.687022 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8191e0a7-2b5e-4b25-ad18-699669edca3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:51.687791 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8191e0a7-2b5e-4b25-ad18-699669edca3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:51.689448 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8191e0a7-2b5e-4b25-ad18-699669edca3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:51.721041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.objects.instance [None req-8191e0a7-2b5e-4b25-ad18-699669edca3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lazy-loading 'flavor' on Instance uuid 40960ef3-1318-49f6-9a5e-c5b12205f0f6 {{(pid=123600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:39:51.840402 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8191e0a7-2b5e-4b25-ad18-699669edca3a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "POST /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6/action" status: 200 len: 32 microversion: 2.1 time: 0.165357 May 11 07:39:51.841428 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 84/170] 10.222.0.36 () {60 vars in 1277 bytes} [Wed May 11 07:39:51 2022] POST /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 11 07:39:51.855036 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-563d66a3-d4be-4f8a-9f34-dc23d8ea8993 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:51.856370 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-563d66a3-d4be-4f8a-9f34-dc23d8ea8993 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:51.869513 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-563d66a3-d4be-4f8a-9f34-dc23d8ea8993 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:51.871961 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-563d66a3-d4be-4f8a-9f34-dc23d8ea8993 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:51.873369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-563d66a3-d4be-4f8a-9f34-dc23d8ea8993 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:51.874433 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-563d66a3-d4be-4f8a-9f34-dc23d8ea8993 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:52.061411 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-563d66a3-d4be-4f8a-9f34-dc23d8ea8993 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:52.074559 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-563d66a3-d4be-4f8a-9f34-dc23d8ea8993 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.227649 May 11 07:39:52.075134 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 87/171] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:51 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:53.092740 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-0cc6952b-9312-4f95-a2a1-0ecb0db5dc3d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:53.093441 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-0cc6952b-9312-4f95-a2a1-0ecb0db5dc3d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:53.099480 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0cc6952b-9312-4f95-a2a1-0ecb0db5dc3d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:53.099920 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0cc6952b-9312-4f95-a2a1-0ecb0db5dc3d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:53.100695 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0cc6952b-9312-4f95-a2a1-0ecb0db5dc3d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:53.101104 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0cc6952b-9312-4f95-a2a1-0ecb0db5dc3d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:53.184093 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-0a06e21e-bef4-4a55-9f89-05633c132767 req-9fae5fe4-06d8-4ae0-9976-f6e1c3000114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e62bda3-ed20-4c7e-a3c8-aa90f6f79937", "tag": "95cc9cfe-62b1-4c76-8e8f-f82e3b55dada"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:39:53.193702 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-0a06e21e-bef4-4a55-9f89-05633c132767 req-9fae5fe4-06d8-4ae0-9976-f6e1c3000114 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:53.194318 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-0a06e21e-bef4-4a55-9f89-05633c132767 req-9fae5fe4-06d8-4ae0-9976-f6e1c3000114 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:53.206037 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-0a06e21e-bef4-4a55-9f89-05633c132767 req-9fae5fe4-06d8-4ae0-9976-f6e1c3000114 service nova] Creating event network-changed:95cc9cfe-62b1-4c76-8e8f-f82e3b55dada for instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 on hv-cinder-83699 May 11 07:39:53.211045 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-0a06e21e-bef4-4a55-9f89-05633c132767 req-9fae5fe4-06d8-4ae0-9976-f6e1c3000114 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030673 May 11 07:39:53.211624 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 88/172] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:39:53.240590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0cc6952b-9312-4f95-a2a1-0ecb0db5dc3d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:53.247921 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-0cc6952b-9312-4f95-a2a1-0ecb0db5dc3d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.159878 May 11 07:39:53.248485 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 85/173] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:53 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:54.265379 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-00f614c9-5c43-4f23-b14e-99dc6cd717cc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:54.266094 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-00f614c9-5c43-4f23-b14e-99dc6cd717cc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:54.272285 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-00f614c9-5c43-4f23-b14e-99dc6cd717cc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:54.272760 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-00f614c9-5c43-4f23-b14e-99dc6cd717cc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:54.273549 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-00f614c9-5c43-4f23-b14e-99dc6cd717cc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:54.273987 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-00f614c9-5c43-4f23-b14e-99dc6cd717cc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:54.514108 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-00f614c9-5c43-4f23-b14e-99dc6cd717cc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:54.523950 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-00f614c9-5c43-4f23-b14e-99dc6cd717cc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.263272 May 11 07:39:54.524813 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 89/174] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:54 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:55.541524 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4de91c1c-a138-4c3c-87ea-8b1af3a5e88b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:55.542153 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4de91c1c-a138-4c3c-87ea-8b1af3a5e88b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:55.548055 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4de91c1c-a138-4c3c-87ea-8b1af3a5e88b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:55.548501 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4de91c1c-a138-4c3c-87ea-8b1af3a5e88b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:55.549269 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4de91c1c-a138-4c3c-87ea-8b1af3a5e88b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:55.549806 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4de91c1c-a138-4c3c-87ea-8b1af3a5e88b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:55.693448 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4de91c1c-a138-4c3c-87ea-8b1af3a5e88b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:55.702699 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4de91c1c-a138-4c3c-87ea-8b1af3a5e88b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.164866 May 11 07:39:55.712181 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 86/175] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:55 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:56.719809 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-78d3f456-6777-45cd-be7b-b30611114ba0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:56.720343 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-78d3f456-6777-45cd-be7b-b30611114ba0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:56.728024 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-78d3f456-6777-45cd-be7b-b30611114ba0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:56.728474 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-78d3f456-6777-45cd-be7b-b30611114ba0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:56.729235 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-78d3f456-6777-45cd-be7b-b30611114ba0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:56.729711 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-78d3f456-6777-45cd-be7b-b30611114ba0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:56.853784 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-78d3f456-6777-45cd-be7b-b30611114ba0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:56.861046 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-78d3f456-6777-45cd-be7b-b30611114ba0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.145109 May 11 07:39:56.861625 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 90/176] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:56 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:57.877575 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8603285f-d39c-49e0-90ff-938ce84c5746 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:57.878172 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8603285f-d39c-49e0-90ff-938ce84c5746 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:57.883977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8603285f-d39c-49e0-90ff-938ce84c5746 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:57.884418 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8603285f-d39c-49e0-90ff-938ce84c5746 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:57.885164 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8603285f-d39c-49e0-90ff-938ce84c5746 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:57.885621 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8603285f-d39c-49e0-90ff-938ce84c5746 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:58.018613 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8603285f-d39c-49e0-90ff-938ce84c5746 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:58.025808 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8603285f-d39c-49e0-90ff-938ce84c5746 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.151964 May 11 07:39:58.026362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 87/177] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:57 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:39:59.042960 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-79f4c30c-4927-4f8d-a450-338c2a030eaa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:39:59.043575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-79f4c30c-4927-4f8d-a450-338c2a030eaa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:39:59.050782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-79f4c30c-4927-4f8d-a450-338c2a030eaa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:59.051238 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-79f4c30c-4927-4f8d-a450-338c2a030eaa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:59.052012 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-79f4c30c-4927-4f8d-a450-338c2a030eaa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:39:59.052453 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-79f4c30c-4927-4f8d-a450-338c2a030eaa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:39:59.176679 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-79f4c30c-4927-4f8d-a450-338c2a030eaa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:39:59.184414 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-79f4c30c-4927-4f8d-a450-338c2a030eaa tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.145338 May 11 07:39:59.184978 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 91/178] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:39:59 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:00.202107 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e2c686a3-fb51-4f16-9436-f1c23660cf81 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:00.202664 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e2c686a3-fb51-4f16-9436-f1c23660cf81 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:00.208650 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e2c686a3-fb51-4f16-9436-f1c23660cf81 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:00.209096 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e2c686a3-fb51-4f16-9436-f1c23660cf81 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:00.209883 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e2c686a3-fb51-4f16-9436-f1c23660cf81 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:00.210317 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e2c686a3-fb51-4f16-9436-f1c23660cf81 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:00.338019 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e2c686a3-fb51-4f16-9436-f1c23660cf81 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:00.345320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e2c686a3-fb51-4f16-9436-f1c23660cf81 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.147605 May 11 07:40:00.345913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 88/179] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:00 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:01.362045 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-36416df6-998f-4c94-b28c-bc277b537002 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:01.362653 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-36416df6-998f-4c94-b28c-bc277b537002 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:01.368950 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-36416df6-998f-4c94-b28c-bc277b537002 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:01.369403 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-36416df6-998f-4c94-b28c-bc277b537002 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:01.370197 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-36416df6-998f-4c94-b28c-bc277b537002 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:01.370638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-36416df6-998f-4c94-b28c-bc277b537002 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:01.496622 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-36416df6-998f-4c94-b28c-bc277b537002 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:01.503900 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-36416df6-998f-4c94-b28c-bc277b537002 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.145611 May 11 07:40:01.504465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 92/180] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:01 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:02.521381 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-614dbc34-c981-4aa7-b83b-799737f8daa7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:02.522010 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-614dbc34-c981-4aa7-b83b-799737f8daa7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:02.527897 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-614dbc34-c981-4aa7-b83b-799737f8daa7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:02.528342 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-614dbc34-c981-4aa7-b83b-799737f8daa7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:02.529102 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-614dbc34-c981-4aa7-b83b-799737f8daa7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:02.529533 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-614dbc34-c981-4aa7-b83b-799737f8daa7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:02.653666 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-614dbc34-c981-4aa7-b83b-799737f8daa7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:02.660755 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-614dbc34-c981-4aa7-b83b-799737f8daa7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.143275 May 11 07:40:02.661310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 89/181] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:02 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:03.678463 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-8dfc9b08-28f3-4738-95d3-4cc0e1e512c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:03.679068 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-8dfc9b08-28f3-4738-95d3-4cc0e1e512c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:03.685444 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8dfc9b08-28f3-4738-95d3-4cc0e1e512c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:03.685910 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8dfc9b08-28f3-4738-95d3-4cc0e1e512c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:03.686670 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8dfc9b08-28f3-4738-95d3-4cc0e1e512c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:03.687092 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8dfc9b08-28f3-4738-95d3-4cc0e1e512c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:03.813012 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-8dfc9b08-28f3-4738-95d3-4cc0e1e512c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:03.820554 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-8dfc9b08-28f3-4738-95d3-4cc0e1e512c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.146106 May 11 07:40:03.821110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 93/182] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:03 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:04.837185 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-0105bdb2-9a26-4a65-b282-4eb351345d21 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:04.837810 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-0105bdb2-9a26-4a65-b282-4eb351345d21 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:04.843678 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0105bdb2-9a26-4a65-b282-4eb351345d21 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:04.844119 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0105bdb2-9a26-4a65-b282-4eb351345d21 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:04.844868 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0105bdb2-9a26-4a65-b282-4eb351345d21 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:04.845293 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0105bdb2-9a26-4a65-b282-4eb351345d21 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:04.968879 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0105bdb2-9a26-4a65-b282-4eb351345d21 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:04.976064 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-0105bdb2-9a26-4a65-b282-4eb351345d21 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.142716 May 11 07:40:04.976610 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 90/183] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:04 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:05.993128 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d4d35663-eff7-4922-9976-517d8ea04d3c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:05.993790 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d4d35663-eff7-4922-9976-517d8ea04d3c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:06.000181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4d35663-eff7-4922-9976-517d8ea04d3c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:06.000631 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4d35663-eff7-4922-9976-517d8ea04d3c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:06.001398 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4d35663-eff7-4922-9976-517d8ea04d3c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:06.001860 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4d35663-eff7-4922-9976-517d8ea04d3c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:06.131694 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d4d35663-eff7-4922-9976-517d8ea04d3c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:06.140018 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d4d35663-eff7-4922-9976-517d8ea04d3c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.150764 May 11 07:40:06.140900 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 94/184] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:05 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:07.156496 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-00a261c4-9114-4c41-84b9-59d8a8dee16f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:07.157152 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-00a261c4-9114-4c41-84b9-59d8a8dee16f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:07.163117 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00a261c4-9114-4c41-84b9-59d8a8dee16f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:07.163561 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00a261c4-9114-4c41-84b9-59d8a8dee16f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:07.164315 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00a261c4-9114-4c41-84b9-59d8a8dee16f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:07.164778 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00a261c4-9114-4c41-84b9-59d8a8dee16f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:07.288104 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-00a261c4-9114-4c41-84b9-59d8a8dee16f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:07.295954 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-00a261c4-9114-4c41-84b9-59d8a8dee16f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.143755 May 11 07:40:07.296774 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 91/185] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:07 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:08.312860 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-9ced77a7-97be-4d56-8492-7bc2360a3e91 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:08.313467 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-9ced77a7-97be-4d56-8492-7bc2360a3e91 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:08.319968 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9ced77a7-97be-4d56-8492-7bc2360a3e91 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:08.320413 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9ced77a7-97be-4d56-8492-7bc2360a3e91 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:08.321199 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9ced77a7-97be-4d56-8492-7bc2360a3e91 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:08.321671 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9ced77a7-97be-4d56-8492-7bc2360a3e91 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:08.446889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-9ced77a7-97be-4d56-8492-7bc2360a3e91 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:08.454363 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-9ced77a7-97be-4d56-8492-7bc2360a3e91 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.145928 May 11 07:40:08.454938 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 95/186] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:08 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:09.471710 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-05f5cc0e-92a1-44e5-bc09-55a53d15ec90 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:09.472305 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-05f5cc0e-92a1-44e5-bc09-55a53d15ec90 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:09.478718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-05f5cc0e-92a1-44e5-bc09-55a53d15ec90 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:09.479162 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-05f5cc0e-92a1-44e5-bc09-55a53d15ec90 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:09.479913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-05f5cc0e-92a1-44e5-bc09-55a53d15ec90 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:09.480342 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-05f5cc0e-92a1-44e5-bc09-55a53d15ec90 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:09.605016 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-05f5cc0e-92a1-44e5-bc09-55a53d15ec90 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:09.612290 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-05f5cc0e-92a1-44e5-bc09-55a53d15ec90 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.144423 May 11 07:40:09.612859 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 92/187] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:09 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:10.629709 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b69afa3e-51e6-4759-b659-a26b9777e97b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:10.630263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-b69afa3e-51e6-4759-b659-a26b9777e97b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:10.637053 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b69afa3e-51e6-4759-b659-a26b9777e97b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:10.637524 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b69afa3e-51e6-4759-b659-a26b9777e97b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:10.638343 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b69afa3e-51e6-4759-b659-a26b9777e97b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:10.638777 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b69afa3e-51e6-4759-b659-a26b9777e97b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:10.813424 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-b69afa3e-51e6-4759-b659-a26b9777e97b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:10.813424 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-b69afa3e-51e6-4759-b659-a26b9777e97b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.185519 May 11 07:40:10.813424 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 96/188] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:10 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:11.830847 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c3ad68c0-65d6-4bec-9a0a-1c1786d1cc83 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:11.831575 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c3ad68c0-65d6-4bec-9a0a-1c1786d1cc83 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:11.837435 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c3ad68c0-65d6-4bec-9a0a-1c1786d1cc83 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:11.837915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c3ad68c0-65d6-4bec-9a0a-1c1786d1cc83 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:11.838691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c3ad68c0-65d6-4bec-9a0a-1c1786d1cc83 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:11.839127 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c3ad68c0-65d6-4bec-9a0a-1c1786d1cc83 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:11.989073 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c3ad68c0-65d6-4bec-9a0a-1c1786d1cc83 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:11.997860 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c3ad68c0-65d6-4bec-9a0a-1c1786d1cc83 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.170683 May 11 07:40:11.999444 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 93/189] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:11 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:13.016561 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c34ec9c0-7e9e-43d4-948c-8905783bb3df tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:13.017166 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-c34ec9c0-7e9e-43d4-948c-8905783bb3df tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:13.023472 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c34ec9c0-7e9e-43d4-948c-8905783bb3df tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:13.023921 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c34ec9c0-7e9e-43d4-948c-8905783bb3df tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:13.024685 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c34ec9c0-7e9e-43d4-948c-8905783bb3df tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:13.025116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c34ec9c0-7e9e-43d4-948c-8905783bb3df tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:13.151921 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-c34ec9c0-7e9e-43d4-948c-8905783bb3df tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:13.159165 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c34ec9c0-7e9e-43d4-948c-8905783bb3df tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.146420 May 11 07:40:13.159722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 97/190] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:13 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:14.176007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a90ad794-dbb5-4534-9166-217a8b6ef831 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:14.176586 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a90ad794-dbb5-4534-9166-217a8b6ef831 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:14.183295 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a90ad794-dbb5-4534-9166-217a8b6ef831 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:14.183740 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a90ad794-dbb5-4534-9166-217a8b6ef831 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:14.184507 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a90ad794-dbb5-4534-9166-217a8b6ef831 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:14.184935 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a90ad794-dbb5-4534-9166-217a8b6ef831 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:14.321346 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a90ad794-dbb5-4534-9166-217a8b6ef831 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:14.329796 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a90ad794-dbb5-4534-9166-217a8b6ef831 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.157716 May 11 07:40:14.340452 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 94/191] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:14 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:15.349053 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-31654de1-145a-4674-b457-53367f4375e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:15.349684 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-31654de1-145a-4674-b457-53367f4375e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:15.356800 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-31654de1-145a-4674-b457-53367f4375e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:15.357519 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-31654de1-145a-4674-b457-53367f4375e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:15.358531 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-31654de1-145a-4674-b457-53367f4375e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:15.359104 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-31654de1-145a-4674-b457-53367f4375e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:15.613909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-31654de1-145a-4674-b457-53367f4375e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:15.624572 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-31654de1-145a-4674-b457-53367f4375e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.281041 May 11 07:40:15.626083 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 98/192] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:15 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:16.642503 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1996c01f-660a-4816-af84-687a41161ed2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:16.643098 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-1996c01f-660a-4816-af84-687a41161ed2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:16.652398 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1996c01f-660a-4816-af84-687a41161ed2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:16.652398 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1996c01f-660a-4816-af84-687a41161ed2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:16.652398 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1996c01f-660a-4816-af84-687a41161ed2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:16.652398 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1996c01f-660a-4816-af84-687a41161ed2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:16.798548 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-1996c01f-660a-4816-af84-687a41161ed2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:16.806536 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-1996c01f-660a-4816-af84-687a41161ed2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.168033 May 11 07:40:16.807241 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 95/193] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:16 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:17.824888 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0e07879b-ee5e-4ee7-a3e7-0ca317d010cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:17.827050 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0e07879b-ee5e-4ee7-a3e7-0ca317d010cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:17.836166 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0e07879b-ee5e-4ee7-a3e7-0ca317d010cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:17.836612 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0e07879b-ee5e-4ee7-a3e7-0ca317d010cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:17.837382 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0e07879b-ee5e-4ee7-a3e7-0ca317d010cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:17.837890 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0e07879b-ee5e-4ee7-a3e7-0ca317d010cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:18.047611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0e07879b-ee5e-4ee7-a3e7-0ca317d010cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:18.055781 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0e07879b-ee5e-4ee7-a3e7-0ca317d010cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.235654 May 11 07:40:18.056620 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 99/194] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:17 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:18.368482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-980526393", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "networks": [{"uuid": "dfa4b454-8bbb-460d-a846-a88ee9e3b47d"}]}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:18.443858 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.network.neutron [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] validate_networks() for [('dfa4b454-8bbb-460d-a846-a88ee9e3b47d', None, None, None, None, None)] {{(pid=123600) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:40:19.076974 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d8421e37-a1d4-48dc-a439-5b2dfeffff43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:19.078113 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d8421e37-a1d4-48dc-a439-5b2dfeffff43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:19.089724 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d8421e37-a1d4-48dc-a439-5b2dfeffff43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:19.091038 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d8421e37-a1d4-48dc-a439-5b2dfeffff43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:19.092000 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d8421e37-a1d4-48dc-a439-5b2dfeffff43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:19.092582 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d8421e37-a1d4-48dc-a439-5b2dfeffff43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:19.422866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d8421e37-a1d4-48dc-a439-5b2dfeffff43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:19.432650 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d8421e37-a1d4-48dc-a439-5b2dfeffff43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1501 microversion: 2.1 time: 0.360129 May 11 07:40:19.434791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 100/195] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:19 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1501 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:19.452732 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7fd0c717-4ddb-432c-a0e7-cc95367a5131 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bc65dc4-4edc-42c5-89a4-6c985e1f95fd"}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:19.453957 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-7fd0c717-4ddb-432c-a0e7-cc95367a5131 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:19.460760 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7fd0c717-4ddb-432c-a0e7-cc95367a5131 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:19.461348 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7fd0c717-4ddb-432c-a0e7-cc95367a5131 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:19.462401 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7fd0c717-4ddb-432c-a0e7-cc95367a5131 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:19.462907 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7fd0c717-4ddb-432c-a0e7-cc95367a5131 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:19.506196 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Flavor limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:40:19.506715 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Image limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:40:19.507312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Flavor pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:40:19.507777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Image pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:40:19.508588 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:40:19.516297 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-7fd0c717-4ddb-432c-a0e7-cc95367a5131 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] HTTP exception thrown: Cannot 'attach_volume' instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 while it is in vm_state rescued May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7fd0c717-4ddb-432c-a0e7-cc95367a5131 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Request method failure captured: May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: POST /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6/os-volume_attachments HTTP/1.1 May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 74 May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2f4-oKoOE9FBE_RG9FyTwLAv71Px09UBPVP8kenpsEj9SvNzuf6dLSpds-XnOcgdDSjVYNcNr-a5d9Do_2WrjGr2ab1y3lCX6jNf_ktVP1a30PDbGS6tB9iHuA2uLFyNLZOALi5jjB7EvTJ0KtAwD21SpqDnA9bNus1EZRpHIAcMbE May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 5100c1cfe7f148058734c0da2d1497d4 May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:40:19.520782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:40:19.522084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5100c1cfe7f148058734c0da2d1497d4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5100c1cfe7f148058734c0da2d1497d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5100c1cfe7f148058734c0da2d1497d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5100c1cfe7f148058734c0da2d1497d4"}]}] May 11 07:40:19.522084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:40:19.522084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 5100c1cfe7f148058734c0da2d1497d4 May 11 07:40:19.522084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:40:19.522084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-ServerRescueNegativeTestJSON-280701147-project May 11 07:40:19.522084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:40:19.522084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:40:19.522084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: cb70f7eb7b44487a9ee3f331c83f9e31 May 11 07:40:19.522084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-ServerRescueNegativeTestJSON-280701147-project May 11 07:40:19.522084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: May 11 07:40:19.522084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {"volumeAttachment": {"volumeId": "4bc65dc4-4edc-42c5-89a4-6c985e1f95fd"}} May 11 07:40:19.522084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Cannot 'attach_volume' instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 while it is in vm_state rescued May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'server_id': '40960ef3-1318-49f6-9a5e-c5b12205f0f6', 'body': {'volumeAttachment': {'volumeId': '4bc65dc4-4edc-42c5-89a4-6c985e1f95fd'}}} May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:40:19.522757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 while it is in vm_state rescued May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:40:19.523853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:40:19.525067 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:40:19.525067 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:40:19.525067 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 while it is in vm_state rescued May 11 07:40:19.525067 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:40:19.525320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:19.525394 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7fd0c717-4ddb-432c-a0e7-cc95367a5131 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Returning 409 to user: Cannot 'attach_volume' instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 while it is in vm_state rescued {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:40:19.525394 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-7fd0c717-4ddb-432c-a0e7-cc95367a5131 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "POST /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.076180 May 11 07:40:19.525527 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:19.535987 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:19.535987 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:19.536609 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 101/196] 10.222.0.36 () {60 vars in 1322 bytes} [Wed May 11 07:40:19 2022] POST /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6/os-volume_attachments => generated 152 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 11 07:40:19.552950 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b1b0e358-453d-42e8-b455-c2768c441151 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:19.555623 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-b1b0e358-453d-42e8-b455-c2768c441151 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:19.556654 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Getting quotas for project 70e0fc25f309475d83688bab2b138157. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:40:19.561699 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Getting quotas for user 2a3cf6ced4ed4d4e87cb9934f020b055 and project 70e0fc25f309475d83688bab2b138157. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:40:19.566784 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b1b0e358-453d-42e8-b455-c2768c441151 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:19.568169 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b1b0e358-453d-42e8-b455-c2768c441151 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:19.569680 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b1b0e358-453d-42e8-b455-c2768c441151 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:19.570207 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b1b0e358-453d-42e8-b455-c2768c441151 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:19.574379 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Going to run 1 instances... {{(pid=123600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:40:19.577735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:40:19.625165 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e79082ef-ffc7-41f3-8682-3219eced6099 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.261143 May 11 07:40:19.630690 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 96/197] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:40:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:40:19.635619 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9317d84d-8609-4243-8f50-764d6dd29f31 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:19.636372 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9317d84d-8609-4243-8f50-764d6dd29f31 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:19.669060 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-b1b0e358-453d-42e8-b455-c2768c441151 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "POST /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6/action" status: 202 len: 0 microversion: 2.1 time: 0.138601 May 11 07:40:19.670314 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 102/198] 10.222.0.36 () {60 vars in 1277 bytes} [Wed May 11 07:40:19 2022] POST /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:40:19.682570 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-29e1716d-e757-44ec-aad4-39cc9efe3f35 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:19.684078 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-29e1716d-e757-44ec-aad4-39cc9efe3f35 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:19.691555 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-29e1716d-e757-44ec-aad4-39cc9efe3f35 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:19.692089 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-29e1716d-e757-44ec-aad4-39cc9efe3f35 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:19.693059 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-29e1716d-e757-44ec-aad4-39cc9efe3f35 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:19.693595 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-29e1716d-e757-44ec-aad4-39cc9efe3f35 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:19.705550 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9317d84d-8609-4243-8f50-764d6dd29f31 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:19.722218 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9317d84d-8609-4243-8f50-764d6dd29f31 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1213 microversion: 2.1 time: 0.090212 May 11 07:40:19.725416 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 97/199] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:19 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:20.055949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-29e1716d-e757-44ec-aad4-39cc9efe3f35 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:20.065699 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-29e1716d-e757-44ec-aad4-39cc9efe3f35 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1509 microversion: 2.1 time: 0.388227 May 11 07:40:20.069723 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 103/200] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:19 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1509 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:20.741839 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f701f4f5-1381-4f6b-aa89-8c1ba4c6c91a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:20.743011 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f701f4f5-1381-4f6b-aa89-8c1ba4c6c91a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:20.757274 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f701f4f5-1381-4f6b-aa89-8c1ba4c6c91a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:20.758087 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f701f4f5-1381-4f6b-aa89-8c1ba4c6c91a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:20.758931 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f701f4f5-1381-4f6b-aa89-8c1ba4c6c91a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:20.759416 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f701f4f5-1381-4f6b-aa89-8c1ba4c6c91a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:20.879403 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f701f4f5-1381-4f6b-aa89-8c1ba4c6c91a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:20.890177 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f701f4f5-1381-4f6b-aa89-8c1ba4c6c91a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1265 microversion: 2.1 time: 0.152010 May 11 07:40:20.890771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 98/201] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:20 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:21.084426 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-03c352da-3f62-47fa-8903-059bdb61acd4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:21.085035 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-03c352da-3f62-47fa-8903-059bdb61acd4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:21.094627 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-03c352da-3f62-47fa-8903-059bdb61acd4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:21.094627 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-03c352da-3f62-47fa-8903-059bdb61acd4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:21.095661 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-03c352da-3f62-47fa-8903-059bdb61acd4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:21.096107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-03c352da-3f62-47fa-8903-059bdb61acd4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:21.587202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-03c352da-3f62-47fa-8903-059bdb61acd4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:21.598565 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-03c352da-3f62-47fa-8903-059bdb61acd4 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1509 microversion: 2.1 time: 0.517493 May 11 07:40:21.610581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 104/202] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:21 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1509 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:21.908571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ad66dd31-6ca7-423d-b072-52495bb6f3c6 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:21.909324 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-ad66dd31-6ca7-423d-b072-52495bb6f3c6 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:21.918872 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ad66dd31-6ca7-423d-b072-52495bb6f3c6 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:21.919321 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ad66dd31-6ca7-423d-b072-52495bb6f3c6 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:21.920100 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ad66dd31-6ca7-423d-b072-52495bb6f3c6 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:21.920531 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ad66dd31-6ca7-423d-b072-52495bb6f3c6 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:22.025916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-ad66dd31-6ca7-423d-b072-52495bb6f3c6 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:22.039940 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-ad66dd31-6ca7-423d-b072-52495bb6f3c6 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1265 microversion: 2.1 time: 0.135951 May 11 07:40:22.044831 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 99/203] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:21 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:22.626612 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d4913dea-114f-4f52-bbba-3435a286df7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:22.630268 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d4913dea-114f-4f52-bbba-3435a286df7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:22.644133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4913dea-114f-4f52-bbba-3435a286df7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:22.645288 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4913dea-114f-4f52-bbba-3435a286df7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:22.646443 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4913dea-114f-4f52-bbba-3435a286df7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:22.649110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4913dea-114f-4f52-bbba-3435a286df7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:22.935858 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d4913dea-114f-4f52-bbba-3435a286df7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:22.944158 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d4913dea-114f-4f52-bbba-3435a286df7d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1509 microversion: 2.1 time: 0.331776 May 11 07:40:22.949025 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 105/204] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:22 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1509 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:23.066135 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d6efeb31-1b1c-40ca-9dc1-d17af7f4f8a8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:23.067007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d6efeb31-1b1c-40ca-9dc1-d17af7f4f8a8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:23.078128 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d6efeb31-1b1c-40ca-9dc1-d17af7f4f8a8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:23.078592 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d6efeb31-1b1c-40ca-9dc1-d17af7f4f8a8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:23.079400 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d6efeb31-1b1c-40ca-9dc1-d17af7f4f8a8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:23.079844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d6efeb31-1b1c-40ca-9dc1-d17af7f4f8a8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:23.308631 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d6efeb31-1b1c-40ca-9dc1-d17af7f4f8a8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:23.318965 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d6efeb31-1b1c-40ca-9dc1-d17af7f4f8a8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1271 microversion: 2.1 time: 0.261836 May 11 07:40:23.319881 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 100/205] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:23 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:23.961764 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-aff67418-f4ea-4c4d-89c1-273c1a10874d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:23.962376 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-aff67418-f4ea-4c4d-89c1-273c1a10874d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:23.975570 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-aff67418-f4ea-4c4d-89c1-273c1a10874d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:23.976935 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-aff67418-f4ea-4c4d-89c1-273c1a10874d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:23.977995 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-aff67418-f4ea-4c4d-89c1-273c1a10874d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:23.979038 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-aff67418-f4ea-4c4d-89c1-273c1a10874d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:24.184031 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-aff67418-f4ea-4c4d-89c1-273c1a10874d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:24.192930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-aff67418-f4ea-4c4d-89c1-273c1a10874d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1515 microversion: 2.1 time: 0.235061 May 11 07:40:24.194377 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 106/206] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:23 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:24.336405 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c8894959-a069-470a-86ae-dc9872e4b318 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:24.337023 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c8894959-a069-470a-86ae-dc9872e4b318 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:24.344983 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c8894959-a069-470a-86ae-dc9872e4b318 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:24.345438 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c8894959-a069-470a-86ae-dc9872e4b318 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:24.346380 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c8894959-a069-470a-86ae-dc9872e4b318 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:24.346821 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c8894959-a069-470a-86ae-dc9872e4b318 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:24.775270 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c8894959-a069-470a-86ae-dc9872e4b318 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:24.784281 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c8894959-a069-470a-86ae-dc9872e4b318 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1313 microversion: 2.1 time: 0.451875 May 11 07:40:24.785595 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 101/207] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:24 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:24.857520 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-707b6c01-f51e-4eea-b9d1-42fe4b1a57a0 req-b681b415-e1a2-4285-91c3-a906ff275c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00e8ae3e-0e3e-410b-b293-84228b29a98d", "tag": "501af30f-a266-4e33-ab42-8e5d612377df"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:24.869731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-707b6c01-f51e-4eea-b9d1-42fe4b1a57a0 req-b681b415-e1a2-4285-91c3-a906ff275c7b service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:24.873207 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-707b6c01-f51e-4eea-b9d1-42fe4b1a57a0 req-b681b415-e1a2-4285-91c3-a906ff275c7b service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:24.889414 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-707b6c01-f51e-4eea-b9d1-42fe4b1a57a0 req-b681b415-e1a2-4285-91c3-a906ff275c7b service nova] Creating event network-changed:501af30f-a266-4e33-ab42-8e5d612377df for instance 00e8ae3e-0e3e-410b-b293-84228b29a98d on hv-cinder-83699 May 11 07:40:24.897109 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-707b6c01-f51e-4eea-b9d1-42fe4b1a57a0 req-b681b415-e1a2-4285-91c3-a906ff275c7b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043869 May 11 07:40:24.898345 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 107/208] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:25.802805 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d1b5fd0d-54a2-4b6d-856a-9f24341b25b8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:25.804241 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d1b5fd0d-54a2-4b6d-856a-9f24341b25b8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:25.826039 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d1b5fd0d-54a2-4b6d-856a-9f24341b25b8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:25.826817 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d1b5fd0d-54a2-4b6d-856a-9f24341b25b8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:25.827650 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d1b5fd0d-54a2-4b6d-856a-9f24341b25b8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:25.828096 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d1b5fd0d-54a2-4b6d-856a-9f24341b25b8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:25.858587 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-078968ea-7164-4273-9509-5ef35e6d79bc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Action: 'create', calling method: .version_select at 0x7f19ecd79550>, body: {"keypair": {"name": "tempest-keypair-1725013394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1mz1dU0O6tRSVTN1TJo28uHbD3sbkA+YafdS+SAOcCISRYhJqJUve0xECatS035UClA2iV7X7gJomjn3iQCK9wCuV9+48tDumLP1dBXfZqTb5TeSrkTczUJVdocTEwyg=="}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:25.909312 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-078968ea-7164-4273-9509-5ef35e6d79bc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Getting quotas for project 5100c1cfe7f148058734c0da2d1497d4. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:40:25.914374 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-078968ea-7164-4273-9509-5ef35e6d79bc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Getting quotas for user cb70f7eb7b44487a9ee3f331c83f9e31 and project 5100c1cfe7f148058734c0da2d1497d4. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:40:25.952878 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-078968ea-7164-4273-9509-5ef35e6d79bc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100596 May 11 07:40:25.959987 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 108/209] 10.222.0.36 () {60 vars in 1158 bytes} [Wed May 11 07:40:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:40:26.178768 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d1b5fd0d-54a2-4b6d-856a-9f24341b25b8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:26.192896 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d1b5fd0d-54a2-4b6d-856a-9f24341b25b8 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1313 microversion: 2.1 time: 0.394130 May 11 07:40:26.194050 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 102/210] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:25 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:27.054413 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-98e7455c-aac3-416e-b156-60e80b986e1c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:27.055756 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-98e7455c-aac3-416e-b156-60e80b986e1c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:27.079090 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-98e7455c-aac3-416e-b156-60e80b986e1c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:27.080323 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-98e7455c-aac3-416e-b156-60e80b986e1c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:27.082332 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-98e7455c-aac3-416e-b156-60e80b986e1c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:27.083306 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-98e7455c-aac3-416e-b156-60e80b986e1c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:27.144683 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-98e7455c-aac3-416e-b156-60e80b986e1c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/ips" status: 200 len: 151 microversion: 2.20 time: 0.098244 May 11 07:40:27.149795 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 109/211] 10.222.0.36 () {60 vars in 1288 bytes} [Wed May 11 07:40:27 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/ips => generated 151 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:40:27.211919 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c511a92d-ee36-41f9-9b19-a68785c08f0c tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:27.212595 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c511a92d-ee36-41f9-9b19-a68785c08f0c tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:27.221803 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c511a92d-ee36-41f9-9b19-a68785c08f0c tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:27.223791 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c511a92d-ee36-41f9-9b19-a68785c08f0c tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:27.224962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c511a92d-ee36-41f9-9b19-a68785c08f0c tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:27.225523 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c511a92d-ee36-41f9-9b19-a68785c08f0c tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:27.616806 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c511a92d-ee36-41f9-9b19-a68785c08f0c tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:27.626098 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c511a92d-ee36-41f9-9b19-a68785c08f0c tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1313 microversion: 2.1 time: 0.418564 May 11 07:40:27.626671 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 103/212] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:27 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:28.646416 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a7888953-4d23-4509-8659-7f6effabc709 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:28.647032 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a7888953-4d23-4509-8659-7f6effabc709 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:28.664271 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a7888953-4d23-4509-8659-7f6effabc709 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:28.664730 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a7888953-4d23-4509-8659-7f6effabc709 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:28.669315 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a7888953-4d23-4509-8659-7f6effabc709 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:28.669806 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a7888953-4d23-4509-8659-7f6effabc709 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:28.783041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1542796428", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4d89019-bced-4db2-9253-82870fddaba6"}], "security_groups": [{"name": "tempest-securitygroup--1428438983"}], "key_name": "tempest-keypair-1725013394", "user_data": "}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:29.030906 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a7888953-4d23-4509-8659-7f6effabc709 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:29.040728 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a7888953-4d23-4509-8659-7f6effabc709 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1313 microversion: 2.1 time: 0.398285 May 11 07:40:29.043227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 110/213] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:28 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:29.052572 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.network.neutron [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] validate_networks() for [('c4d89019-bced-4db2-9253-82870fddaba6', None, None, None, None, None)] {{(pid=123600) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:40:29.301990 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-94739504-e09e-4ca8-bf08-04cc0b0528d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:29.302890 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-94739504-e09e-4ca8-bf08-04cc0b0528d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:29.316744 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-94739504-e09e-4ca8-bf08-04cc0b0528d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:29.321318 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-94739504-e09e-4ca8-bf08-04cc0b0528d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:29.322891 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-94739504-e09e-4ca8-bf08-04cc0b0528d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:29.323645 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-94739504-e09e-4ca8-bf08-04cc0b0528d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:29.372217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.objects.instance [None req-94739504-e09e-4ca8-bf08-04cc0b0528d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lazy-loading 'flavor' on Instance uuid acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 {{(pid=123599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:40:29.795324 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Flavor limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:40:29.796409 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Image limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:40:29.797397 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Flavor pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:40:29.798148 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Image pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:40:29.799006 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:40:29.815186 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:29.816637 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:29.817855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:29.821691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:29.853645 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Getting quotas for project 5100c1cfe7f148058734c0da2d1497d4. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:40:29.858884 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Getting quotas for user cb70f7eb7b44487a9ee3f331c83f9e31 and project 5100c1cfe7f148058734c0da2d1497d4. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:40:29.872075 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Going to run 1 instances... {{(pid=123600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:40:29.874520 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:40:29.890109 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-94739504-e09e-4ca8-bf08-04cc0b0528d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "POST /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/action" status: 202 len: 0 microversion: 2.20 time: 0.592170 May 11 07:40:29.892915 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 111/214] 10.222.0.36 () {62 vars in 1318 bytes} [Wed May 11 07:40:29 2022] POST /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 07:40:29.914531 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1291204328", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452"}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:29.952780 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f38ed2cb-b8cd-4fdf-949f-2e85ad64c1fe tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.173890 May 11 07:40:29.955809 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 104/215] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:40:28 2022] POST /compute/v2.1/servers => generated 409 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:40:29.960227 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-10628462-ea66-4b76-b81d-98295a0e545d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:29.961315 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-10628462-ea66-4b76-b81d-98295a0e545d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:29.971217 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-10628462-ea66-4b76-b81d-98295a0e545d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:29.972234 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-10628462-ea66-4b76-b81d-98295a0e545d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:29.973574 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-10628462-ea66-4b76-b81d-98295a0e545d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:29.974355 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-10628462-ea66-4b76-b81d-98295a0e545d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:30.015266 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.network.neutron [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] validate_networks() for None {{(pid=123599) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:40:30.828833 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-10628462-ea66-4b76-b81d-98295a0e545d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:30.846671 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-10628462-ea66-4b76-b81d-98295a0e545d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:30.849067 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-10628462-ea66-4b76-b81d-98295a0e545d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:30.850580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-10628462-ea66-4b76-b81d-98295a0e545d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.895031 May 11 07:40:30.863281 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 105/216] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:29 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:30.871569 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d9ea02c4-df73-4522-8d9e-f94d603f30f0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:30.872822 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d9ea02c4-df73-4522-8d9e-f94d603f30f0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:30.925249 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d9ea02c4-df73-4522-8d9e-f94d603f30f0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:30.930826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d9ea02c4-df73-4522-8d9e-f94d603f30f0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:30.932129 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d9ea02c4-df73-4522-8d9e-f94d603f30f0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:30.933319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d9ea02c4-df73-4522-8d9e-f94d603f30f0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:30.980388 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Flavor limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:40:30.981225 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Image limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:40:30.981767 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Flavor pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:40:30.982187 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Image pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:40:30.982607 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:40:31.012512 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:31.013139 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:31.021500 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:31.022058 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:31.067339 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Getting quotas for project e281a5ed352441838b649ed98a4810df. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:40:31.072391 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d9ea02c4-df73-4522-8d9e-f94d603f30f0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:31.077146 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Getting quotas for user 75e9fc22cd0942ceb526726e66baec29 and project e281a5ed352441838b649ed98a4810df. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:40:31.082526 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d9ea02c4-df73-4522-8d9e-f94d603f30f0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1242 microversion: 2.1 time: 0.216146 May 11 07:40:31.083250 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 106/217] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:30 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1242 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:31.089908 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4c36bb4b-4a50-4290-85f3-cd3926b88791 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:31.091116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4c36bb4b-4a50-4290-85f3-cd3926b88791 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:31.106100 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4c36bb4b-4a50-4290-85f3-cd3926b88791 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:31.107041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4c36bb4b-4a50-4290-85f3-cd3926b88791 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:31.108595 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4c36bb4b-4a50-4290-85f3-cd3926b88791 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:31.110026 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4c36bb4b-4a50-4290-85f3-cd3926b88791 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:31.117264 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Going to run 1 instances... {{(pid=123599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:40:31.120105 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:40:31.177237 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-faaa4113-5426-448c-982f-fccee52ffb31 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.282518 May 11 07:40:31.179628 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 112/218] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:40:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:40:31.185354 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-781e7b99-c0f8-4be9-a26e-53ab6cdd7a9e req-c8906e81-ad32-4667-8829-ca86d744bd84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e8ae3e-0e3e-410b-b293-84228b29a98d", "name": "network-vif-plugged", "status": "completed", "tag": "501af30f-a266-4e33-ab42-8e5d612377df"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:31.194676 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-781e7b99-c0f8-4be9-a26e-53ab6cdd7a9e req-c8906e81-ad32-4667-8829-ca86d744bd84 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:31.195331 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-781e7b99-c0f8-4be9-a26e-53ab6cdd7a9e req-c8906e81-ad32-4667-8829-ca86d744bd84 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:31.207920 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-781e7b99-c0f8-4be9-a26e-53ab6cdd7a9e req-c8906e81-ad32-4667-8829-ca86d744bd84 service nova] Creating event network-vif-plugged:501af30f-a266-4e33-ab42-8e5d612377df for instance 00e8ae3e-0e3e-410b-b293-84228b29a98d on hv-cinder-83699 May 11 07:40:31.214516 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-781e7b99-c0f8-4be9-a26e-53ab6cdd7a9e req-c8906e81-ad32-4667-8829-ca86d744bd84 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032791 May 11 07:40:31.216445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 113/219] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:31.224022 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0b7364e3-e78c-44e3-86a8-c284f92fe19e tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:31.225593 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0b7364e3-e78c-44e3-86a8-c284f92fe19e tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:31.323083 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0b7364e3-e78c-44e3-86a8-c284f92fe19e tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:31.332174 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0b7364e3-e78c-44e3-86a8-c284f92fe19e tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1215 microversion: 2.1 time: 0.110259 May 11 07:40:31.332974 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 114/220] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:31 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:31.360239 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4c36bb4b-4a50-4290-85f3-cd3926b88791 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:31.383378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4c36bb4b-4a50-4290-85f3-cd3926b88791 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1313 microversion: 2.1 time: 0.298728 May 11 07:40:31.403938 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 107/221] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:31 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:31.869245 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-568b763c-62fa-46aa-9f3c-40eafc8e0a4f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:31.870399 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-568b763c-62fa-46aa-9f3c-40eafc8e0a4f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:31.877708 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-568b763c-62fa-46aa-9f3c-40eafc8e0a4f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:31.878329 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-568b763c-62fa-46aa-9f3c-40eafc8e0a4f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:31.879265 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-568b763c-62fa-46aa-9f3c-40eafc8e0a4f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:31.879698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-568b763c-62fa-46aa-9f3c-40eafc8e0a4f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:32.070366 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-568b763c-62fa-46aa-9f3c-40eafc8e0a4f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:32.088023 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-568b763c-62fa-46aa-9f3c-40eafc8e0a4f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:32.090141 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-568b763c-62fa-46aa-9f3c-40eafc8e0a4f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:32.091769 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-568b763c-62fa-46aa-9f3c-40eafc8e0a4f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.226361 May 11 07:40:32.109532 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2ac2af03-4260-4342-bbce-e896562e486d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:32.111015 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2ac2af03-4260-4342-bbce-e896562e486d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:32.115593 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 115/222] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:31 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:32.119579 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2ac2af03-4260-4342-bbce-e896562e486d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:32.120835 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2ac2af03-4260-4342-bbce-e896562e486d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:32.122015 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2ac2af03-4260-4342-bbce-e896562e486d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:32.122655 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2ac2af03-4260-4342-bbce-e896562e486d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:32.205262 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-2ac2af03-4260-4342-bbce-e896562e486d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:32.215084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2ac2af03-4260-4342-bbce-e896562e486d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1304 microversion: 2.1 time: 0.110160 May 11 07:40:32.215813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 108/223] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:32 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:32.349575 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-45af83f4-4533-45e2-ace4-ee1caacb0316 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:32.350198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-45af83f4-4533-45e2-ace4-ee1caacb0316 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:32.357283 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-45af83f4-4533-45e2-ace4-ee1caacb0316 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:32.357922 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-45af83f4-4533-45e2-ace4-ee1caacb0316 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:32.358709 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-45af83f4-4533-45e2-ace4-ee1caacb0316 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:32.359165 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-45af83f4-4533-45e2-ace4-ee1caacb0316 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:32.426580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-45af83f4-4533-45e2-ace4-ee1caacb0316 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:32.434557 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-45af83f4-4533-45e2-ace4-ee1caacb0316 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1267 microversion: 2.1 time: 0.089042 May 11 07:40:32.435217 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 109/224] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:32 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:40:32.440021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a28f787d-a194-4cfd-8177-afc2dde982b1 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:32.440764 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a28f787d-a194-4cfd-8177-afc2dde982b1 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:32.447342 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a28f787d-a194-4cfd-8177-afc2dde982b1 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:32.448089 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a28f787d-a194-4cfd-8177-afc2dde982b1 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:32.449076 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a28f787d-a194-4cfd-8177-afc2dde982b1 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:32.449518 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a28f787d-a194-4cfd-8177-afc2dde982b1 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:32.483225 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-4953ce08-1d4c-4aec-bd25-15428f2b3a6d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Action: 'create', calling method: .version_select at 0x7f19ecbb2ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-678948032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGe04lksOMl4VZJ4vh1YhhDYuWXXVJlynNqmUfclG8ZRwhoTGIv+PyFfGKRCYUbICR/ziJERwN6P/7xQ2AJpVy9raIm0/SEFvu22Rt6Ch/4iKVwoWEC6lqo56KdWwYdSHA=="}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:32.499994 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-4953ce08-1d4c-4aec-bd25-15428f2b3a6d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Getting quotas for project d69ae02f1e0146c795d799160ac17d44. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:40:32.504219 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-4953ce08-1d4c-4aec-bd25-15428f2b3a6d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Getting quotas for user ed2dae16f03c4eff9185087ed50120fc and project d69ae02f1e0146c795d799160ac17d44. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:40:32.530831 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-4953ce08-1d4c-4aec-bd25-15428f2b3a6d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.233933 May 11 07:40:32.531612 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 116/225] 10.222.0.36 () {60 vars in 1158 bytes} [Wed May 11 07:40:32 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:32.644501 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a28f787d-a194-4cfd-8177-afc2dde982b1 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:32.652733 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a28f787d-a194-4cfd-8177-afc2dde982b1 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1313 microversion: 2.1 time: 0.216268 May 11 07:40:32.653303 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 110/226] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:32 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:33.111532 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-024407a5-3122-458b-b759-06006aae41ba tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:33.112252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-024407a5-3122-458b-b759-06006aae41ba tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:33.122282 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-024407a5-3122-458b-b759-06006aae41ba tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:33.122996 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-024407a5-3122-458b-b759-06006aae41ba tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:33.124246 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-024407a5-3122-458b-b759-06006aae41ba tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:33.124853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-024407a5-3122-458b-b759-06006aae41ba tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:33.236118 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3d2b2647-e2cd-4f49-9c74-ef2518cbea6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:33.239347 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3d2b2647-e2cd-4f49-9c74-ef2518cbea6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:33.251739 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3d2b2647-e2cd-4f49-9c74-ef2518cbea6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:33.254241 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3d2b2647-e2cd-4f49-9c74-ef2518cbea6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:33.257086 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3d2b2647-e2cd-4f49-9c74-ef2518cbea6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:33.257700 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3d2b2647-e2cd-4f49-9c74-ef2518cbea6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:33.379676 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-024407a5-3122-458b-b759-06006aae41ba tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:33.390581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-024407a5-3122-458b-b759-06006aae41ba tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:33.392364 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-024407a5-3122-458b-b759-06006aae41ba tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:33.395390 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-024407a5-3122-458b-b759-06006aae41ba tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.288755 May 11 07:40:33.397149 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 117/227] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:33 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:33.440437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3d2b2647-e2cd-4f49-9c74-ef2518cbea6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:33.449638 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3d2b2647-e2cd-4f49-9c74-ef2518cbea6f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1372 microversion: 2.1 time: 0.218283 May 11 07:40:33.450633 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 111/228] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:33 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:33.453031 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0f89b596-f6bc-48af-9dba-4338c9bb5f4c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:33.453667 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0f89b596-f6bc-48af-9dba-4338c9bb5f4c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:33.460296 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0f89b596-f6bc-48af-9dba-4338c9bb5f4c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:33.460742 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0f89b596-f6bc-48af-9dba-4338c9bb5f4c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:33.461507 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0f89b596-f6bc-48af-9dba-4338c9bb5f4c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:33.461959 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0f89b596-f6bc-48af-9dba-4338c9bb5f4c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:33.534526 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0f89b596-f6bc-48af-9dba-4338c9bb5f4c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:33.542540 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0f89b596-f6bc-48af-9dba-4338c9bb5f4c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1275 microversion: 2.1 time: 0.094261 May 11 07:40:33.543302 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 118/229] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:33 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:33.671663 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1462b6ce-ebe1-42f9-bf1e-5ec736c0d91b tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:33.672792 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-1462b6ce-ebe1-42f9-bf1e-5ec736c0d91b tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:33.695188 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1462b6ce-ebe1-42f9-bf1e-5ec736c0d91b tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:33.695902 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1462b6ce-ebe1-42f9-bf1e-5ec736c0d91b tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:33.697509 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1462b6ce-ebe1-42f9-bf1e-5ec736c0d91b tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:33.698186 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1462b6ce-ebe1-42f9-bf1e-5ec736c0d91b tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:34.092902 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-1462b6ce-ebe1-42f9-bf1e-5ec736c0d91b tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:34.101732 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-1462b6ce-ebe1-42f9-bf1e-5ec736c0d91b tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1497 microversion: 2.1 time: 0.436311 May 11 07:40:34.117465 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 112/230] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:33 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1497 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:34.281864 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-71abe27e-849f-4829-9d3f-e9461b348dee req-4aa249a5-a8dc-4431-b2f5-67f6a176a8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b775a5-13c2-4d45-8015-d7a37683cfb1", "tag": "91543a14-0ae8-44e1-bba8-2b3a746fbae8"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:34.295487 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-71abe27e-849f-4829-9d3f-e9461b348dee req-4aa249a5-a8dc-4431-b2f5-67f6a176a8e9 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:34.299805 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-71abe27e-849f-4829-9d3f-e9461b348dee req-4aa249a5-a8dc-4431-b2f5-67f6a176a8e9 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:34.345440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-71abe27e-849f-4829-9d3f-e9461b348dee req-4aa249a5-a8dc-4431-b2f5-67f6a176a8e9 service nova] Creating event network-changed:91543a14-0ae8-44e1-bba8-2b3a746fbae8 for instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 on hv-cinder-83699 May 11 07:40:34.370465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-71abe27e-849f-4829-9d3f-e9461b348dee req-4aa249a5-a8dc-4431-b2f5-67f6a176a8e9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091951 May 11 07:40:34.373231 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 119/231] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:34.415282 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8de676a8-c690-4bfb-b7d9-da17bea0f7f1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:34.415960 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8de676a8-c690-4bfb-b7d9-da17bea0f7f1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:34.471444 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-39a06a25-e6a8-42dd-9121-dac8ba3f0c4d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:34.472490 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-39a06a25-e6a8-42dd-9121-dac8ba3f0c4d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:34.490546 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8de676a8-c690-4bfb-b7d9-da17bea0f7f1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:34.495062 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8de676a8-c690-4bfb-b7d9-da17bea0f7f1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:34.498951 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8de676a8-c690-4bfb-b7d9-da17bea0f7f1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:34.499407 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8de676a8-c690-4bfb-b7d9-da17bea0f7f1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:34.502427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-39a06a25-e6a8-42dd-9121-dac8ba3f0c4d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:34.503045 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-39a06a25-e6a8-42dd-9121-dac8ba3f0c4d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:34.503829 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-39a06a25-e6a8-42dd-9121-dac8ba3f0c4d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:34.504255 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-39a06a25-e6a8-42dd-9121-dac8ba3f0c4d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:34.913385 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-39a06a25-e6a8-42dd-9121-dac8ba3f0c4d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:34.923357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-39a06a25-e6a8-42dd-9121-dac8ba3f0c4d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1372 microversion: 2.1 time: 0.460342 May 11 07:40:34.924370 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 120/232] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:34 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1372 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:34.948564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-fdec9705-a0c1-46e3-8e43-6cc0515df328 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:34.950729 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-fdec9705-a0c1-46e3-8e43-6cc0515df328 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:34.966770 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fdec9705-a0c1-46e3-8e43-6cc0515df328 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:34.969830 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fdec9705-a0c1-46e3-8e43-6cc0515df328 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:34.970728 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fdec9705-a0c1-46e3-8e43-6cc0515df328 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:34.974076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fdec9705-a0c1-46e3-8e43-6cc0515df328 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:35.120508 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-fdec9705-a0c1-46e3-8e43-6cc0515df328 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:35.131812 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8de676a8-c690-4bfb-b7d9-da17bea0f7f1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:35.152848 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8de676a8-c690-4bfb-b7d9-da17bea0f7f1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:35.154972 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-fdec9705-a0c1-46e3-8e43-6cc0515df328 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1273 microversion: 2.1 time: 0.215803 May 11 07:40:35.164499 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 121/233] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:34 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1273 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:35.164837 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8de676a8-c690-4bfb-b7d9-da17bea0f7f1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:35.164837 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8de676a8-c690-4bfb-b7d9-da17bea0f7f1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.749426 May 11 07:40:35.179942 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 113/234] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:34 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:35.186501 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7df54645-5000-42d8-81ef-aa7c6f5e7c22 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:35.187020 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-7df54645-5000-42d8-81ef-aa7c6f5e7c22 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:35.210533 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7df54645-5000-42d8-81ef-aa7c6f5e7c22 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:35.211161 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7df54645-5000-42d8-81ef-aa7c6f5e7c22 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:35.213107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7df54645-5000-42d8-81ef-aa7c6f5e7c22 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:35.216880 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7df54645-5000-42d8-81ef-aa7c6f5e7c22 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:35.267312 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-7df54645-5000-42d8-81ef-aa7c6f5e7c22 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Going to try to terminate instance {{(pid=123599) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:40:35.348648 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-7df54645-5000-42d8-81ef-aa7c6f5e7c22 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "DELETE /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 204 len: 0 microversion: 2.1 time: 0.191382 May 11 07:40:35.349954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 122/235] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:40:35 2022] DELETE /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:40:35.358823 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c26200f3-e8a0-4b90-ab42-5d584fe1f2d3 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:35.359433 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c26200f3-e8a0-4b90-ab42-5d584fe1f2d3 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:35.365913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c26200f3-e8a0-4b90-ab42-5d584fe1f2d3 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:35.366414 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c26200f3-e8a0-4b90-ab42-5d584fe1f2d3 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:35.367370 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c26200f3-e8a0-4b90-ab42-5d584fe1f2d3 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:35.367862 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c26200f3-e8a0-4b90-ab42-5d584fe1f2d3 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:35.642146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c26200f3-e8a0-4b90-ab42-5d584fe1f2d3 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:35.653987 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c26200f3-e8a0-4b90-ab42-5d584fe1f2d3 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1503 microversion: 2.1 time: 0.299689 May 11 07:40:35.664295 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 114/236] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:35 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:35.942507 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-5e9eaf72-eb05-4cf0-9452-a324740c23fc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:35.943322 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-5e9eaf72-eb05-4cf0-9452-a324740c23fc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:35.952146 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5e9eaf72-eb05-4cf0-9452-a324740c23fc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:35.952595 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5e9eaf72-eb05-4cf0-9452-a324740c23fc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:35.953372 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5e9eaf72-eb05-4cf0-9452-a324740c23fc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:35.953841 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5e9eaf72-eb05-4cf0-9452-a324740c23fc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:36.093453 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-5e9eaf72-eb05-4cf0-9452-a324740c23fc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:36.103403 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-5e9eaf72-eb05-4cf0-9452-a324740c23fc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1372 microversion: 2.1 time: 0.166695 May 11 07:40:36.104043 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 123/237] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:35 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:36.172895 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-857a6fda-714a-4fe3-831c-088a7b85148d tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:36.173469 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-857a6fda-714a-4fe3-831c-088a7b85148d tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:36.181932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-91ee2685-0de0-4084-9726-31296a93fdeb tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:36.182467 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-91ee2685-0de0-4084-9726-31296a93fdeb tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:36.183635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-857a6fda-714a-4fe3-831c-088a7b85148d tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:36.184083 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-857a6fda-714a-4fe3-831c-088a7b85148d tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:36.184856 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-857a6fda-714a-4fe3-831c-088a7b85148d tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:36.185286 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-857a6fda-714a-4fe3-831c-088a7b85148d tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:36.191587 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-91ee2685-0de0-4084-9726-31296a93fdeb tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:36.192820 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-91ee2685-0de0-4084-9726-31296a93fdeb tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:36.200128 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-91ee2685-0de0-4084-9726-31296a93fdeb tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:36.200128 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-91ee2685-0de0-4084-9726-31296a93fdeb tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:36.470619 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-857a6fda-714a-4fe3-831c-088a7b85148d tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:36.486711 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-857a6fda-714a-4fe3-831c-088a7b85148d tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1315 microversion: 2.1 time: 0.318040 May 11 07:40:36.487520 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 115/238] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:36 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:36.545863 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-91ee2685-0de0-4084-9726-31296a93fdeb tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:36.555224 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-91ee2685-0de0-4084-9726-31296a93fdeb tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:36.556986 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-91ee2685-0de0-4084-9726-31296a93fdeb tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:36.559844 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-91ee2685-0de0-4084-9726-31296a93fdeb tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.382770 May 11 07:40:36.564742 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 124/239] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:36 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:36.671879 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-aa41d442-882b-48ee-855a-6528df528300 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:36.673186 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-aa41d442-882b-48ee-855a-6528df528300 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:36.679528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aa41d442-882b-48ee-855a-6528df528300 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:36.680150 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aa41d442-882b-48ee-855a-6528df528300 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:36.681002 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aa41d442-882b-48ee-855a-6528df528300 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:36.681509 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aa41d442-882b-48ee-855a-6528df528300 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:36.902075 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-aa41d442-882b-48ee-855a-6528df528300 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:36.911838 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-aa41d442-882b-48ee-855a-6528df528300 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1503 microversion: 2.1 time: 0.243659 May 11 07:40:36.915173 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 116/240] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:36 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1503 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:37.122670 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-acff0fa1-e943-46b1-92f5-ff4e020d3ece tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:37.123854 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-acff0fa1-e943-46b1-92f5-ff4e020d3ece tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:37.133090 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-acff0fa1-e943-46b1-92f5-ff4e020d3ece tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:37.133533 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-acff0fa1-e943-46b1-92f5-ff4e020d3ece tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:37.134619 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-acff0fa1-e943-46b1-92f5-ff4e020d3ece tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:37.135214 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-acff0fa1-e943-46b1-92f5-ff4e020d3ece tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:37.310182 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-5113e4d2-edff-4e96-8885-484ffdc35e0b req-f8812ab3-a09a-4544-a886-edf223bec71e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99693cf3-0e4b-48d0-ac99-eb076109897c", "tag": "020deed5-aef1-4456-9dc9-a8f5b1255561"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:37.319628 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-5113e4d2-edff-4e96-8885-484ffdc35e0b req-f8812ab3-a09a-4544-a886-edf223bec71e service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:37.320082 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-5113e4d2-edff-4e96-8885-484ffdc35e0b req-f8812ab3-a09a-4544-a886-edf223bec71e service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:37.334569 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-5113e4d2-edff-4e96-8885-484ffdc35e0b req-f8812ab3-a09a-4544-a886-edf223bec71e service nova] Creating event network-changed:020deed5-aef1-4456-9dc9-a8f5b1255561 for instance 99693cf3-0e4b-48d0-ac99-eb076109897c on hv-cinder-83699 May 11 07:40:37.352558 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-5113e4d2-edff-4e96-8885-484ffdc35e0b req-f8812ab3-a09a-4544-a886-edf223bec71e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045810 May 11 07:40:37.354020 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 117/241] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:40:37.364650 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-acff0fa1-e943-46b1-92f5-ff4e020d3ece tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:37.377818 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-acff0fa1-e943-46b1-92f5-ff4e020d3ece tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1372 microversion: 2.1 time: 0.261797 May 11 07:40:37.378960 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 125/242] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:37 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1372 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:37.512756 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-6c7853b7-ddb8-41a9-907f-87f6d1d6dc9c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:37.513452 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-6c7853b7-ddb8-41a9-907f-87f6d1d6dc9c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:37.519778 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6c7853b7-ddb8-41a9-907f-87f6d1d6dc9c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:37.520227 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6c7853b7-ddb8-41a9-907f-87f6d1d6dc9c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:37.520998 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6c7853b7-ddb8-41a9-907f-87f6d1d6dc9c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:37.521430 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6c7853b7-ddb8-41a9-907f-87f6d1d6dc9c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:37.578512 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-9e548726-b437-4a88-b762-7ebe304236fc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:37.585035 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-9e548726-b437-4a88-b762-7ebe304236fc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:37.595439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9e548726-b437-4a88-b762-7ebe304236fc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:37.595891 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9e548726-b437-4a88-b762-7ebe304236fc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:37.596722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9e548726-b437-4a88-b762-7ebe304236fc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:37.597234 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9e548726-b437-4a88-b762-7ebe304236fc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:37.763257 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-6c7853b7-ddb8-41a9-907f-87f6d1d6dc9c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:37.772693 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-6c7853b7-ddb8-41a9-907f-87f6d1d6dc9c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1315 microversion: 2.1 time: 0.265418 May 11 07:40:37.777194 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 118/243] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:37 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:37.785873 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c1d9837e-97d7-4788-8b30-778e2eaf460e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:37.786649 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c1d9837e-97d7-4788-8b30-778e2eaf460e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:37.795643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c1d9837e-97d7-4788-8b30-778e2eaf460e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:37.796123 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c1d9837e-97d7-4788-8b30-778e2eaf460e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:37.797523 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c1d9837e-97d7-4788-8b30-778e2eaf460e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:37.798020 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c1d9837e-97d7-4788-8b30-778e2eaf460e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:37.826384 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c1d9837e-97d7-4788-8b30-778e2eaf460e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/ips" status: 200 len: 145 microversion: 2.1 time: 0.051693 May 11 07:40:37.827200 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 119/244] 10.222.0.36 () {58 vars in 1247 bytes} [Wed May 11 07:40:37 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:37.867037 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-9e548726-b437-4a88-b762-7ebe304236fc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:37.876956 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-9e548726-b437-4a88-b762-7ebe304236fc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:37.878852 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-9e548726-b437-4a88-b762-7ebe304236fc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:37.880118 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-9e548726-b437-4a88-b762-7ebe304236fc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.305459 May 11 07:40:37.880752 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 126/245] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:37 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:37.930519 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-bf9a07ea-efad-4090-8677-cf728ffedd38 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:37.931130 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-bf9a07ea-efad-4090-8677-cf728ffedd38 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:37.938027 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bf9a07ea-efad-4090-8677-cf728ffedd38 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:37.938525 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bf9a07ea-efad-4090-8677-cf728ffedd38 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:37.939296 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bf9a07ea-efad-4090-8677-cf728ffedd38 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:37.939764 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bf9a07ea-efad-4090-8677-cf728ffedd38 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:38.201737 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-bf9a07ea-efad-4090-8677-cf728ffedd38 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:38.211802 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-bf9a07ea-efad-4090-8677-cf728ffedd38 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1503 microversion: 2.1 time: 0.285089 May 11 07:40:38.213435 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 120/246] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:37 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1503 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:38.399403 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-46aff6e9-ff58-4a6a-9aa5-2d64fede573b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:38.400807 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-46aff6e9-ff58-4a6a-9aa5-2d64fede573b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:38.408843 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-46aff6e9-ff58-4a6a-9aa5-2d64fede573b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:38.409528 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-46aff6e9-ff58-4a6a-9aa5-2d64fede573b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:38.410676 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-46aff6e9-ff58-4a6a-9aa5-2d64fede573b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:38.411807 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-46aff6e9-ff58-4a6a-9aa5-2d64fede573b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:38.427901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-bacdd6bb-8114-4da8-8f64-4b99539a3298 req-94ee17d8-0da2-45dc-be4f-bd05b29e6034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b775a5-13c2-4d45-8015-d7a37683cfb1", "name": "network-vif-plugged", "status": "completed", "tag": "91543a14-0ae8-44e1-bba8-2b3a746fbae8"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:38.446960 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-bacdd6bb-8114-4da8-8f64-4b99539a3298 req-94ee17d8-0da2-45dc-be4f-bd05b29e6034 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:38.450466 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-bacdd6bb-8114-4da8-8f64-4b99539a3298 req-94ee17d8-0da2-45dc-be4f-bd05b29e6034 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:38.482646 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-bacdd6bb-8114-4da8-8f64-4b99539a3298 req-94ee17d8-0da2-45dc-be4f-bd05b29e6034 service nova] Creating event network-vif-plugged:91543a14-0ae8-44e1-bba8-2b3a746fbae8 for instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 on hv-cinder-83699 May 11 07:40:38.494088 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-bacdd6bb-8114-4da8-8f64-4b99539a3298 req-94ee17d8-0da2-45dc-be4f-bd05b29e6034 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071268 May 11 07:40:38.495921 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 121/247] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:38.791251 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a1d03006-177e-40a0-abd0-70207d3a884c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:38.792581 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a1d03006-177e-40a0-abd0-70207d3a884c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:38.799176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a1d03006-177e-40a0-abd0-70207d3a884c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:38.799626 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a1d03006-177e-40a0-abd0-70207d3a884c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:38.800411 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a1d03006-177e-40a0-abd0-70207d3a884c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:38.800847 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a1d03006-177e-40a0-abd0-70207d3a884c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:39.022885 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-46aff6e9-ff58-4a6a-9aa5-2d64fede573b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:39.030661 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-46aff6e9-ff58-4a6a-9aa5-2d64fede573b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1372 microversion: 2.1 time: 0.638492 May 11 07:40:39.031254 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 127/248] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:38 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1372 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:39.036234 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-73cdb34f-4af2-4a7b-aecd-66fe395def09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:39.036836 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-73cdb34f-4af2-4a7b-aecd-66fe395def09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:39.043611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-73cdb34f-4af2-4a7b-aecd-66fe395def09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:39.048622 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-73cdb34f-4af2-4a7b-aecd-66fe395def09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:39.049505 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-73cdb34f-4af2-4a7b-aecd-66fe395def09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:39.050063 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-73cdb34f-4af2-4a7b-aecd-66fe395def09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:39.153947 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a1d03006-177e-40a0-abd0-70207d3a884c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:39.164994 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a1d03006-177e-40a0-abd0-70207d3a884c tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1315 microversion: 2.1 time: 0.378214 May 11 07:40:39.165766 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 122/249] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:38 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:40:39.229108 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7d815a44-a431-43f7-8458-f06694c669ef tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:39.229765 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7d815a44-a431-43f7-8458-f06694c669ef tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:39.235933 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7d815a44-a431-43f7-8458-f06694c669ef tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:39.236434 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7d815a44-a431-43f7-8458-f06694c669ef tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:39.237196 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7d815a44-a431-43f7-8458-f06694c669ef tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:39.237664 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7d815a44-a431-43f7-8458-f06694c669ef tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:39.313446 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-73cdb34f-4af2-4a7b-aecd-66fe395def09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:39.315343 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7d815a44-a431-43f7-8458-f06694c669ef tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:39.321741 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-73cdb34f-4af2-4a7b-aecd-66fe395def09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:39.322756 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7d815a44-a431-43f7-8458-f06694c669ef tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1461 microversion: 2.1 time: 0.097497 May 11 07:40:39.323812 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-73cdb34f-4af2-4a7b-aecd-66fe395def09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:39.323954 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 123/250] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:39 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1461 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:40:39.325237 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-73cdb34f-4af2-4a7b-aecd-66fe395def09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.292926 May 11 07:40:39.325826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 128/251] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:39 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:39.374689 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-aa6a3def-5f41-44ef-9dc5-0f03d60e8b00 req-aefd632b-65d1-4736-bf6f-7fef4ab8cf72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e8ae3e-0e3e-410b-b293-84228b29a98d", "name": "network-vif-deleted", "tag": "501af30f-a266-4e33-ab42-8e5d612377df"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:39.382546 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-aa6a3def-5f41-44ef-9dc5-0f03d60e8b00 req-aefd632b-65d1-4736-bf6f-7fef4ab8cf72 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:39.383028 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-aa6a3def-5f41-44ef-9dc5-0f03d60e8b00 req-aefd632b-65d1-4736-bf6f-7fef4ab8cf72 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:39.395885 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-aa6a3def-5f41-44ef-9dc5-0f03d60e8b00 req-aefd632b-65d1-4736-bf6f-7fef4ab8cf72 service nova] Creating event network-vif-deleted:501af30f-a266-4e33-ab42-8e5d612377df for instance 00e8ae3e-0e3e-410b-b293-84228b29a98d on hv-cinder-83699 May 11 07:40:39.401201 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-aa6a3def-5f41-44ef-9dc5-0f03d60e8b00 req-aefd632b-65d1-4736-bf6f-7fef4ab8cf72 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030119 May 11 07:40:39.401810 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 124/252] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:40.048561 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-80ff15e6-0587-40a6-a901-93504b6444bb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:40.049168 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-80ff15e6-0587-40a6-a901-93504b6444bb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:40.056120 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-80ff15e6-0587-40a6-a901-93504b6444bb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:40.056777 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-80ff15e6-0587-40a6-a901-93504b6444bb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:40.058469 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-80ff15e6-0587-40a6-a901-93504b6444bb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:40.059186 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-80ff15e6-0587-40a6-a901-93504b6444bb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:40.182777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2dadf67d-d905-41ac-bf5b-5349e45a92c2 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:40.183468 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2dadf67d-d905-41ac-bf5b-5349e45a92c2 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:40.189387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2dadf67d-d905-41ac-bf5b-5349e45a92c2 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:40.189869 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2dadf67d-d905-41ac-bf5b-5349e45a92c2 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:40.190662 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2dadf67d-d905-41ac-bf5b-5349e45a92c2 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:40.191073 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2dadf67d-d905-41ac-bf5b-5349e45a92c2 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:40.192674 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-80ff15e6-0587-40a6-a901-93504b6444bb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:40.199945 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-80ff15e6-0587-40a6-a901-93504b6444bb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1372 microversion: 2.1 time: 0.155364 May 11 07:40:40.200519 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 129/253] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:40 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:40.342880 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0d136942-5394-4d9b-b867-1277714a702f tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:40.343740 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0d136942-5394-4d9b-b867-1277714a702f tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:40.351790 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0d136942-5394-4d9b-b867-1277714a702f tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:40.352248 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0d136942-5394-4d9b-b867-1277714a702f tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:40.353086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0d136942-5394-4d9b-b867-1277714a702f tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:40.353764 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0d136942-5394-4d9b-b867-1277714a702f tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:40.439295 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0d136942-5394-4d9b-b867-1277714a702f tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:40.448438 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0d136942-5394-4d9b-b867-1277714a702f tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1298 microversion: 2.1 time: 0.110679 May 11 07:40:40.453680 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 130/254] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:40 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:40:40.467531 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-60c6eb23-2a2c-4c93-80a1-c8b31f1d42d2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:40.468147 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-60c6eb23-2a2c-4c93-80a1-c8b31f1d42d2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:40.474229 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-60c6eb23-2a2c-4c93-80a1-c8b31f1d42d2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:40.474904 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-60c6eb23-2a2c-4c93-80a1-c8b31f1d42d2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:40.475678 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-60c6eb23-2a2c-4c93-80a1-c8b31f1d42d2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:40.476106 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-60c6eb23-2a2c-4c93-80a1-c8b31f1d42d2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:40.512126 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-2dadf67d-d905-41ac-bf5b-5349e45a92c2 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:40.521951 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2dadf67d-d905-41ac-bf5b-5349e45a92c2 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1315 microversion: 2.1 time: 0.343066 May 11 07:40:40.523319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 125/255] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:40 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:40:40.618568 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-60c6eb23-2a2c-4c93-80a1-c8b31f1d42d2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:40.626517 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-60c6eb23-2a2c-4c93-80a1-c8b31f1d42d2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:40.628319 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-60c6eb23-2a2c-4c93-80a1-c8b31f1d42d2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:40.629511 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-60c6eb23-2a2c-4c93-80a1-c8b31f1d42d2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.170391 May 11 07:40:40.630091 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 131/256] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:40 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:41.107418 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b998188d-8258-4477-b7b7-6c07f131458a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ba86d77-35d0-4cee-af1e-384b9f038add"}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:41.108536 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-b998188d-8258-4477-b7b7-6c07f131458a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:41.114570 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b998188d-8258-4477-b7b7-6c07f131458a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:41.115021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b998188d-8258-4477-b7b7-6c07f131458a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:41.115791 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b998188d-8258-4477-b7b7-6c07f131458a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:41.116228 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b998188d-8258-4477-b7b7-6c07f131458a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:41.216003 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-44ce6d33-300a-49b3-8dad-0436bc9250c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:41.216612 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-44ce6d33-300a-49b3-8dad-0436bc9250c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:41.222988 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-44ce6d33-300a-49b3-8dad-0436bc9250c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:41.223432 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-44ce6d33-300a-49b3-8dad-0436bc9250c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:41.224196 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-44ce6d33-300a-49b3-8dad-0436bc9250c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:41.224629 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-44ce6d33-300a-49b3-8dad-0436bc9250c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:41.361996 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-44ce6d33-300a-49b3-8dad-0436bc9250c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:41.369145 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-44ce6d33-300a-49b3-8dad-0436bc9250c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1566 microversion: 2.1 time: 0.156950 May 11 07:40:41.370344 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 132/257] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:41 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:40:41.386108 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c6f89c5d-e4d2-4909-81eb-ffb3878d8589 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:41.386594 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-c6f89c5d-e4d2-4909-81eb-ffb3878d8589 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:41.393028 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c6f89c5d-e4d2-4909-81eb-ffb3878d8589 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:41.393474 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c6f89c5d-e4d2-4909-81eb-ffb3878d8589 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:41.394316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c6f89c5d-e4d2-4909-81eb-ffb3878d8589 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:41.394945 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c6f89c5d-e4d2-4909-81eb-ffb3878d8589 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:41.472460 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c6f89c5d-e4d2-4909-81eb-ffb3878d8589 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090252 May 11 07:40:41.473054 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 133/258] 10.222.0.36 () {58 vars in 1274 bytes} [Wed May 11 07:40:41 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:41.478233 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-480bfc2d-75db-41ee-9bb5-899baf343588 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:41.480052 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-480bfc2d-75db-41ee-9bb5-899baf343588 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:41.486165 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-480bfc2d-75db-41ee-9bb5-899baf343588 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:41.486565 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-480bfc2d-75db-41ee-9bb5-899baf343588 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:41.487336 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-480bfc2d-75db-41ee-9bb5-899baf343588 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:41.487804 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-480bfc2d-75db-41ee-9bb5-899baf343588 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:41.521045 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-480bfc2d-75db-41ee-9bb5-899baf343588 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:41.521516 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-480bfc2d-75db-41ee-9bb5-899baf343588 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:41.522171 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.objects.instance [None req-480bfc2d-75db-41ee-9bb5-899baf343588 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lazy-loading 'fault' on Instance uuid 00e8ae3e-0e3e-410b-b293-84228b29a98d {{(pid=123599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:40:41.573088 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-480bfc2d-75db-41ee-9bb5-899baf343588 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:41.580839 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-480bfc2d-75db-41ee-9bb5-899baf343588 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 200 len: 1303 microversion: 2.1 time: 0.106562 May 11 07:40:41.581412 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 134/259] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:41 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:41.586898 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0eec4a9e-f63c-47f5-bded-e149421016fa tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:41.586898 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0eec4a9e-f63c-47f5-bded-e149421016fa tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:41.592912 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0eec4a9e-f63c-47f5-bded-e149421016fa tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:41.593447 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0eec4a9e-f63c-47f5-bded-e149421016fa tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:41.594163 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0eec4a9e-f63c-47f5-bded-e149421016fa tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:41.594676 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0eec4a9e-f63c-47f5-bded-e149421016fa tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:41.749661 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0eec4a9e-f63c-47f5-bded-e149421016fa tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:41.762485 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0eec4a9e-f63c-47f5-bded-e149421016fa tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1315 microversion: 2.1 time: 0.179571 May 11 07:40:41.764363 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 135/260] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:41 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:41.770593 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-95c80664-cdb4-4f67-948c-9b57ef7dcbf2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:41.771687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-95c80664-cdb4-4f67-948c-9b57ef7dcbf2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:41.783436 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-95c80664-cdb4-4f67-948c-9b57ef7dcbf2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:41.783905 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-95c80664-cdb4-4f67-948c-9b57ef7dcbf2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:41.784746 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-95c80664-cdb4-4f67-948c-9b57ef7dcbf2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:41.785185 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-95c80664-cdb4-4f67-948c-9b57ef7dcbf2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:41.935933 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-95c80664-cdb4-4f67-948c-9b57ef7dcbf2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:41.944949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-95c80664-cdb4-4f67-948c-9b57ef7dcbf2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:41.946739 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-95c80664-cdb4-4f67-948c-9b57ef7dcbf2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:41.948560 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-95c80664-cdb4-4f67-948c-9b57ef7dcbf2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.182287 May 11 07:40:41.949243 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 136/261] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:41 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:42.005424 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-b998188d-8258-4477-b7b7-6c07f131458a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "POST /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.901994 May 11 07:40:42.006045 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 126/262] 10.222.0.36 () {60 vars in 1322 bytes} [Wed May 11 07:40:41 2022] POST /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:42.427391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-1b2f0cf3-a217-4cba-b1c3-117084f4ea58 req-f3d1cd88-8165-462d-974d-8d6c0e531b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99693cf3-0e4b-48d0-ac99-eb076109897c", "name": "network-vif-plugged", "status": "completed", "tag": "020deed5-aef1-4456-9dc9-a8f5b1255561"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:42.436788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-1b2f0cf3-a217-4cba-b1c3-117084f4ea58 req-f3d1cd88-8165-462d-974d-8d6c0e531b13 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:42.437340 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-1b2f0cf3-a217-4cba-b1c3-117084f4ea58 req-f3d1cd88-8165-462d-974d-8d6c0e531b13 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:42.449958 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-1b2f0cf3-a217-4cba-b1c3-117084f4ea58 req-f3d1cd88-8165-462d-974d-8d6c0e531b13 service nova] Creating event network-vif-plugged:020deed5-aef1-4456-9dc9-a8f5b1255561 for instance 99693cf3-0e4b-48d0-ac99-eb076109897c on hv-cinder-83699 May 11 07:40:42.460954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-1b2f0cf3-a217-4cba-b1c3-117084f4ea58 req-f3d1cd88-8165-462d-974d-8d6c0e531b13 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037279 May 11 07:40:42.462533 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 137/263] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:42.599529 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4a5075d6-16ab-4760-a0ae-b13ddbdb02a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:42.600295 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4a5075d6-16ab-4760-a0ae-b13ddbdb02a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 00e8ae3e-0e3e-410b-b293-84228b29a98d] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:42.608225 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4a5075d6-16ab-4760-a0ae-b13ddbdb02a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:42.609033 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4a5075d6-16ab-4760-a0ae-b13ddbdb02a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:42.609854 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4a5075d6-16ab-4760-a0ae-b13ddbdb02a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:42.610460 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4a5075d6-16ab-4760-a0ae-b13ddbdb02a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:42.628699 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-4a5075d6-16ab-4760-a0ae-b13ddbdb02a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] HTTP exception thrown: Instance 00e8ae3e-0e3e-410b-b293-84228b29a98d could not be found. May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4a5075d6-16ab-4760-a0ae-b13ddbdb02a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Request method failure captured: May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d HTTP/1.1 May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2hgc9_LvcDjMUIcnwbN_GoQ9x8FbyTUXMcFoK-Ojq63MAFmcMUNE9HdsDr5SIAXebQ71FgJj2NnB_naNyGsrSYWL54JcIcbT5MIOweyzQL-KWgTYJVpEeeAVlFx2kJUuGPUWTN80plVOhyLC88Gp3Cyin80hLmm7-8vByhVuVXcocE May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 70e0fc25f309475d83688bab2b138157 May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-VolumesActionsTest-1045756326 May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:40:42.630738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:40:42.632528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_70e0fc25f309475d83688bab2b138157", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/70e0fc25f309475d83688bab2b138157"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/70e0fc25f309475d83688bab2b138157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/70e0fc25f309475d83688bab2b138157"}]}] May 11 07:40:42.632528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-VolumesActionsTest-1045756326 May 11 07:40:42.632528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 70e0fc25f309475d83688bab2b138157 May 11 07:40:42.632528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-VolumesActionsTest-1045756326 May 11 07:40:42.632528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-VolumesActionsTest-1045756326-project May 11 07:40:42.632528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:40:42.632528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:40:42.632528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: 2a3cf6ced4ed4d4e87cb9934f020b055 May 11 07:40:42.632528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-VolumesActionsTest-1045756326-project May 11 07:40:42.632528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:40:42.632528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 00e8ae3e-0e3e-410b-b293-84228b29a98d could not be found. May 11 07:40:42.632528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '00e8ae3e-0e3e-410b-b293-84228b29a98d'} May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00e8ae3e-0e3e-410b-b293-84228b29a98d could not be found. May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:40:42.633604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00e8ae3e-0e3e-410b-b293-84228b29a98d could not be found. May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00e8ae3e-0e3e-410b-b293-84228b29a98d could not be found. May 11 07:40:42.635041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:40:42.637138 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4a5075d6-16ab-4760-a0ae-b13ddbdb02a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Returning 404 to user: Instance 00e8ae3e-0e3e-410b-b293-84228b29a98d could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:40:42.638050 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4a5075d6-16ab-4760-a0ae-b13ddbdb02a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d" status: 404 len: 111 microversion: 2.1 time: 0.043300 May 11 07:40:42.638797 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 127/264] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:42 2022] GET /compute/v2.1/servers/00e8ae3e-0e3e-410b-b293-84228b29a98d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:40:42.771734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-227191203", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "networks": [{"uuid": "dfa4b454-8bbb-460d-a846-a88ee9e3b47d"}]}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:42.781856 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-00ff8221-aa05-495c-9bbc-79ed4479df34 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:42.782692 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-00ff8221-aa05-495c-9bbc-79ed4479df34 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:42.791833 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00ff8221-aa05-495c-9bbc-79ed4479df34 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:42.793136 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00ff8221-aa05-495c-9bbc-79ed4479df34 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:42.794807 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00ff8221-aa05-495c-9bbc-79ed4479df34 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:42.795255 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00ff8221-aa05-495c-9bbc-79ed4479df34 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:42.831536 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.network.neutron [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] validate_networks() for [('dfa4b454-8bbb-460d-a846-a88ee9e3b47d', None, None, None, None, None)] {{(pid=123599) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:40:43.016944 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-00ff8221-aa05-495c-9bbc-79ed4479df34 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:43.028625 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-00ff8221-aa05-495c-9bbc-79ed4479df34 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1315 microversion: 2.1 time: 0.252458 May 11 07:40:43.029195 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 128/265] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:42 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:40:43.033964 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-6b462373-af23-4dc3-bb3a-7ada7b7d5402 req-732f8801-6819-421f-912e-84eb72f6d78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b775a5-13c2-4d45-8015-d7a37683cfb1", "tag": "91543a14-0ae8-44e1-bba8-2b3a746fbae8"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:43.041861 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-6b462373-af23-4dc3-bb3a-7ada7b7d5402 req-732f8801-6819-421f-912e-84eb72f6d78b service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:43.042506 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-6b462373-af23-4dc3-bb3a-7ada7b7d5402 req-732f8801-6819-421f-912e-84eb72f6d78b service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:43.053925 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-6b462373-af23-4dc3-bb3a-7ada7b7d5402 req-732f8801-6819-421f-912e-84eb72f6d78b service nova] Creating event network-changed:91543a14-0ae8-44e1-bba8-2b3a746fbae8 for instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 on hv-cinder-83699 May 11 07:40:43.059819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-6b462373-af23-4dc3-bb3a-7ada7b7d5402 req-732f8801-6819-421f-912e-84eb72f6d78b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029272 May 11 07:40:43.062137 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 129/266] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:43.070001 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9cd831be-326a-4c38-b518-930caab414e5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:43.070778 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9cd831be-326a-4c38-b518-930caab414e5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:43.082397 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9cd831be-326a-4c38-b518-930caab414e5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:43.082933 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9cd831be-326a-4c38-b518-930caab414e5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:43.083952 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9cd831be-326a-4c38-b518-930caab414e5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:43.084465 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9cd831be-326a-4c38-b518-930caab414e5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:43.351363 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9cd831be-326a-4c38-b518-930caab414e5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:43.360458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9cd831be-326a-4c38-b518-930caab414e5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:43.362006 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9cd831be-326a-4c38-b518-930caab414e5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:43.363174 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9cd831be-326a-4c38-b518-930caab414e5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.299748 May 11 07:40:43.363910 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 130/267] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:43 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:43.413728 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Flavor limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:40:43.414150 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Image limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:40:43.414623 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Flavor pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:40:43.415093 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Image pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:40:43.415527 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:40:43.424615 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:43.425056 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:43.425898 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:43.426329 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:43.444015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Getting quotas for project 70e0fc25f309475d83688bab2b138157. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:40:43.447917 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Getting quotas for user 2a3cf6ced4ed4d4e87cb9934f020b055 and project 70e0fc25f309475d83688bab2b138157. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:40:43.459029 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Going to run 1 instances... {{(pid=123599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:40:43.461533 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:40:43.507062 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-89a6543b-ce46-494d-a2f0-21514f5b27fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739951 May 11 07:40:43.508124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 138/268] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:40:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:40:43.518782 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5c36e01b-656e-4321-929b-f60dc53c98e7 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:43.519555 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-5c36e01b-656e-4321-929b-f60dc53c98e7 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:43.603747 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-5c36e01b-656e-4321-929b-f60dc53c98e7 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:43.611609 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-5c36e01b-656e-4321-929b-f60dc53c98e7 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1213 microversion: 2.1 time: 0.096892 May 11 07:40:43.612497 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 131/269] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:43 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:40:44.045315 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2013bde7-4884-44d5-918e-05ac9b4e30b0 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:44.045957 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2013bde7-4884-44d5-918e-05ac9b4e30b0 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:44.052171 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2013bde7-4884-44d5-918e-05ac9b4e30b0 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:44.052618 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2013bde7-4884-44d5-918e-05ac9b4e30b0 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:44.053382 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2013bde7-4884-44d5-918e-05ac9b4e30b0 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:44.053847 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2013bde7-4884-44d5-918e-05ac9b4e30b0 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:44.189290 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2013bde7-4884-44d5-918e-05ac9b4e30b0 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:44.196856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2013bde7-4884-44d5-918e-05ac9b4e30b0 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1465 microversion: 2.1 time: 0.156124 May 11 07:40:44.197411 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 139/270] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:44 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:44.237612 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9fdb6838-fd25-4605-b997-56b787f1df12 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:44.238112 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9fdb6838-fd25-4605-b997-56b787f1df12 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:44.244743 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9fdb6838-fd25-4605-b997-56b787f1df12 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:44.245189 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9fdb6838-fd25-4605-b997-56b787f1df12 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:44.245987 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9fdb6838-fd25-4605-b997-56b787f1df12 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:44.246421 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9fdb6838-fd25-4605-b997-56b787f1df12 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:44.271650 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9fdb6838-fd25-4605-b997-56b787f1df12 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Going to try to terminate instance {{(pid=123600) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:40:44.353110 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9fdb6838-fd25-4605-b997-56b787f1df12 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "DELETE /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 204 len: 0 microversion: 2.1 time: 0.118983 May 11 07:40:44.353707 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 132/271] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:40:44 2022] DELETE /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:40:44.362089 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-84eb2dec-c303-462e-a698-d523603d9591 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:44.362695 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-84eb2dec-c303-462e-a698-d523603d9591 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:44.368539 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84eb2dec-c303-462e-a698-d523603d9591 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:44.368988 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84eb2dec-c303-462e-a698-d523603d9591 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:44.369780 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84eb2dec-c303-462e-a698-d523603d9591 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:44.370263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84eb2dec-c303-462e-a698-d523603d9591 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:44.382197 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1afb34c1-e970-4ce5-92c8-3366ac951b3a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:44.382882 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-1afb34c1-e970-4ce5-92c8-3366ac951b3a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:44.389036 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1afb34c1-e970-4ce5-92c8-3366ac951b3a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:44.389480 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1afb34c1-e970-4ce5-92c8-3366ac951b3a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:44.390452 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1afb34c1-e970-4ce5-92c8-3366ac951b3a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:44.390886 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1afb34c1-e970-4ce5-92c8-3366ac951b3a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:44.632495 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-84eb2dec-c303-462e-a698-d523603d9591 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:44.640422 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-84eb2dec-c303-462e-a698-d523603d9591 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1471 microversion: 2.1 time: 0.282149 May 11 07:40:44.641525 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 140/272] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:44 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1471 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:44.646362 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-168d91b0-21c3-4694-b10b-f63f9d6eab37 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:44.646960 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-168d91b0-21c3-4694-b10b-f63f9d6eab37 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:44.652893 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-168d91b0-21c3-4694-b10b-f63f9d6eab37 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:44.653333 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-168d91b0-21c3-4694-b10b-f63f9d6eab37 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:44.654136 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-168d91b0-21c3-4694-b10b-f63f9d6eab37 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:44.654564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-168d91b0-21c3-4694-b10b-f63f9d6eab37 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:44.661946 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-1afb34c1-e970-4ce5-92c8-3366ac951b3a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:44.670082 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-1afb34c1-e970-4ce5-92c8-3366ac951b3a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:44.671702 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-1afb34c1-e970-4ce5-92c8-3366ac951b3a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:44.672960 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-1afb34c1-e970-4ce5-92c8-3366ac951b3a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.294964 May 11 07:40:44.673766 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 133/273] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:44 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 07:40:44.725904 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-168d91b0-21c3-4694-b10b-f63f9d6eab37 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:44.734258 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-168d91b0-21c3-4694-b10b-f63f9d6eab37 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1209 microversion: 2.1 time: 0.091361 May 11 07:40:44.735010 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 141/274] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:44 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:45.658113 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-55805418-f853-47ce-a42c-c9cdde17aaf3 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:45.658769 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-55805418-f853-47ce-a42c-c9cdde17aaf3 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:45.665225 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-55805418-f853-47ce-a42c-c9cdde17aaf3 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:45.665747 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-55805418-f853-47ce-a42c-c9cdde17aaf3 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:45.666544 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-55805418-f853-47ce-a42c-c9cdde17aaf3 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:45.666997 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-55805418-f853-47ce-a42c-c9cdde17aaf3 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:45.691960 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-14b12a01-e8d2-45dd-a45f-a2c36b75e14e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:45.692593 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-14b12a01-e8d2-45dd-a45f-a2c36b75e14e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:45.699332 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-14b12a01-e8d2-45dd-a45f-a2c36b75e14e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:45.699781 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-14b12a01-e8d2-45dd-a45f-a2c36b75e14e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:45.700549 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-14b12a01-e8d2-45dd-a45f-a2c36b75e14e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:45.700985 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-14b12a01-e8d2-45dd-a45f-a2c36b75e14e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:45.854093 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-55805418-f853-47ce-a42c-c9cdde17aaf3 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:45.866689 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-55805418-f853-47ce-a42c-c9cdde17aaf3 tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1471 microversion: 2.1 time: 0.212280 May 11 07:40:45.867666 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 134/275] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:45 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1471 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:45.882827 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f810c7f6-7d28-41db-9456-62cc3a2b25fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:45.883443 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f810c7f6-7d28-41db-9456-62cc3a2b25fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:45.889789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f810c7f6-7d28-41db-9456-62cc3a2b25fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:45.890243 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f810c7f6-7d28-41db-9456-62cc3a2b25fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:45.891009 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f810c7f6-7d28-41db-9456-62cc3a2b25fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:45.891445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f810c7f6-7d28-41db-9456-62cc3a2b25fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:45.915232 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-14b12a01-e8d2-45dd-a45f-a2c36b75e14e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:45.923506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-14b12a01-e8d2-45dd-a45f-a2c36b75e14e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:45.925021 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-14b12a01-e8d2-45dd-a45f-a2c36b75e14e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:45.926238 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-14b12a01-e8d2-45dd-a45f-a2c36b75e14e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.238430 May 11 07:40:45.926796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 142/276] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:45 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 07:40:45.979003 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f810c7f6-7d28-41db-9456-62cc3a2b25fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:45.986744 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f810c7f6-7d28-41db-9456-62cc3a2b25fa tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1265 microversion: 2.1 time: 0.107639 May 11 07:40:45.987563 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 135/277] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:45 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:46.883957 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d25a10af-0ccf-455d-99c3-b6daf8281baf tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:46.885190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d25a10af-0ccf-455d-99c3-b6daf8281baf tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:46.892161 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d25a10af-0ccf-455d-99c3-b6daf8281baf tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:46.893414 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d25a10af-0ccf-455d-99c3-b6daf8281baf tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:46.894256 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d25a10af-0ccf-455d-99c3-b6daf8281baf tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:46.894704 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d25a10af-0ccf-455d-99c3-b6daf8281baf tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:46.944522 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3e93e1d8-fafa-497a-ae8a-96153d486ea3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:46.945182 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3e93e1d8-fafa-497a-ae8a-96153d486ea3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:46.951525 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3e93e1d8-fafa-497a-ae8a-96153d486ea3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:46.951981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3e93e1d8-fafa-497a-ae8a-96153d486ea3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:46.952754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3e93e1d8-fafa-497a-ae8a-96153d486ea3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:46.953193 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3e93e1d8-fafa-497a-ae8a-96153d486ea3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:47.224524 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d25a10af-0ccf-455d-99c3-b6daf8281baf tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:47.229269 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3e93e1d8-fafa-497a-ae8a-96153d486ea3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:47.232143 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d25a10af-0ccf-455d-99c3-b6daf8281baf tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1471 microversion: 2.1 time: 0.351902 May 11 07:40:47.232807 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 143/278] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:46 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1471 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:47.244965 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-50ea9bef-e588-4df3-8272-f06c6d43649a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:47.245842 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-50ea9bef-e588-4df3-8272-f06c6d43649a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:47.246394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3e93e1d8-fafa-497a-ae8a-96153d486ea3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:47.247895 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3e93e1d8-fafa-497a-ae8a-96153d486ea3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:47.249047 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3e93e1d8-fafa-497a-ae8a-96153d486ea3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1743 microversion: 2.20 time: 0.308810 May 11 07:40:47.249780 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 136/279] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:46 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1743 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 07:40:47.252697 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-50ea9bef-e588-4df3-8272-f06c6d43649a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:47.252697 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-50ea9bef-e588-4df3-8272-f06c6d43649a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:47.253527 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-50ea9bef-e588-4df3-8272-f06c6d43649a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:47.254051 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-50ea9bef-e588-4df3-8272-f06c6d43649a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:47.362244 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-50ea9bef-e588-4df3-8272-f06c6d43649a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:47.369807 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-50ea9bef-e588-4df3-8272-f06c6d43649a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1271 microversion: 2.1 time: 0.135798 May 11 07:40:47.371122 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 144/280] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:47 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:47.421165 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-bfdd6368-0cc7-45f1-ad6f-a5ab0cc991e3 req-4add765e-a2a5-4c3e-95fa-46b7f4f8125c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99693cf3-0e4b-48d0-ac99-eb076109897c", "name": "network-vif-deleted", "tag": "020deed5-aef1-4456-9dc9-a8f5b1255561"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:47.432192 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-bfdd6368-0cc7-45f1-ad6f-a5ab0cc991e3 req-4add765e-a2a5-4c3e-95fa-46b7f4f8125c service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:47.432836 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-bfdd6368-0cc7-45f1-ad6f-a5ab0cc991e3 req-4add765e-a2a5-4c3e-95fa-46b7f4f8125c service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:47.445490 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-bfdd6368-0cc7-45f1-ad6f-a5ab0cc991e3 req-4add765e-a2a5-4c3e-95fa-46b7f4f8125c service nova] Creating event network-vif-deleted:020deed5-aef1-4456-9dc9-a8f5b1255561 for instance 99693cf3-0e4b-48d0-ac99-eb076109897c on hv-cinder-83699 May 11 07:40:47.456696 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-bfdd6368-0cc7-45f1-ad6f-a5ab0cc991e3 req-4add765e-a2a5-4c3e-95fa-46b7f4f8125c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040408 May 11 07:40:47.458019 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 137/281] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:48.249829 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2def4710-d042-4970-b617-6065a5eb54de tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:48.250360 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2def4710-d042-4970-b617-6065a5eb54de tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:48.257031 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2def4710-d042-4970-b617-6065a5eb54de tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:48.257483 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2def4710-d042-4970-b617-6065a5eb54de tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:48.258301 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2def4710-d042-4970-b617-6065a5eb54de tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:48.258742 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2def4710-d042-4970-b617-6065a5eb54de tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:48.270633 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-94ffaa62-7a97-456b-8c2d-b371c28959dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:48.271513 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-94ffaa62-7a97-456b-8c2d-b371c28959dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:48.279662 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-94ffaa62-7a97-456b-8c2d-b371c28959dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:48.280110 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-94ffaa62-7a97-456b-8c2d-b371c28959dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:48.280876 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-94ffaa62-7a97-456b-8c2d-b371c28959dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:48.281636 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-94ffaa62-7a97-456b-8c2d-b371c28959dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:48.291264 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2def4710-d042-4970-b617-6065a5eb54de tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:48.291719 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2def4710-d042-4970-b617-6065a5eb54de tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:48.293957 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.objects.instance [None req-2def4710-d042-4970-b617-6065a5eb54de tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lazy-loading 'fault' on Instance uuid 99693cf3-0e4b-48d0-ac99-eb076109897c {{(pid=123599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:40:48.407035 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2def4710-d042-4970-b617-6065a5eb54de tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e9fc22cd0942ceb526726e66baec29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e281a5ed352441838b649ed98a4810df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:48.414444 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2def4710-d042-4970-b617-6065a5eb54de tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 200 len: 1305 microversion: 2.1 time: 0.169257 May 11 07:40:48.424430 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 145/282] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:48 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 1305 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:48.438976 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c6bb998f-cffa-47ab-8e4e-88ccfb7db573 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:48.439791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-c6bb998f-cffa-47ab-8e4e-88ccfb7db573 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:48.446480 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c6bb998f-cffa-47ab-8e4e-88ccfb7db573 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:48.447182 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c6bb998f-cffa-47ab-8e4e-88ccfb7db573 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:48.447955 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c6bb998f-cffa-47ab-8e4e-88ccfb7db573 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:48.448424 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c6bb998f-cffa-47ab-8e4e-88ccfb7db573 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:48.641836 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-94ffaa62-7a97-456b-8c2d-b371c28959dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:48.649783 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-94ffaa62-7a97-456b-8c2d-b371c28959dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:48.652280 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-94ffaa62-7a97-456b-8c2d-b371c28959dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:48.653473 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-94ffaa62-7a97-456b-8c2d-b371c28959dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1743 microversion: 2.20 time: 0.388298 May 11 07:40:48.654341 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 138/283] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:48 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1743 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:48.658591 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-22d8b13d-abf8-43a0-8143-b53d9fa417f1 req-98fddbe2-ceac-4989-aa5a-81082c9052a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe41f4-cc5e-4cc7-bc04-ebff35bfd769", "name": "network-vif-plugged", "status": "completed", "tag": "1e8c8dbc-18a9-44e8-8ac6-273b984ed899"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:48.666235 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-22d8b13d-abf8-43a0-8143-b53d9fa417f1 req-98fddbe2-ceac-4989-aa5a-81082c9052a3 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:48.666679 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-22d8b13d-abf8-43a0-8143-b53d9fa417f1 req-98fddbe2-ceac-4989-aa5a-81082c9052a3 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:48.678041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-22d8b13d-abf8-43a0-8143-b53d9fa417f1 req-98fddbe2-ceac-4989-aa5a-81082c9052a3 service nova] Creating event network-vif-plugged:1e8c8dbc-18a9-44e8-8ac6-273b984ed899 for instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 on hv-cinder-83699 May 11 07:40:48.683029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-22d8b13d-abf8-43a0-8143-b53d9fa417f1 req-98fddbe2-ceac-4989-aa5a-81082c9052a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027714 May 11 07:40:48.683803 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 139/284] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:48.736960 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-c6bb998f-cffa-47ab-8e4e-88ccfb7db573 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:48.744154 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c6bb998f-cffa-47ab-8e4e-88ccfb7db573 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1313 microversion: 2.1 time: 0.318496 May 11 07:40:48.744721 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 146/285] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:48 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:49.432209 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b7e018c3-c0b7-4447-b2bf-3b182ae5497b tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:49.433485 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-b7e018c3-c0b7-4447-b2bf-3b182ae5497b tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] [instance: 99693cf3-0e4b-48d0-ac99-eb076109897c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:49.439893 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b7e018c3-c0b7-4447-b2bf-3b182ae5497b tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:49.440545 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b7e018c3-c0b7-4447-b2bf-3b182ae5497b tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:49.441606 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b7e018c3-c0b7-4447-b2bf-3b182ae5497b tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:49.442045 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b7e018c3-c0b7-4447-b2bf-3b182ae5497b tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:49.457056 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-b7e018c3-c0b7-4447-b2bf-3b182ae5497b tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] HTTP exception thrown: Instance 99693cf3-0e4b-48d0-ac99-eb076109897c could not be found. May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b7e018c3-c0b7-4447-b2bf-3b182ae5497b tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Request method failure captured: May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c HTTP/1.1 May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2hrS9e-U4Sjpequ4h8Jm1PvnHV9qm57wRVULZY8EyCRIhj6Dtl3hDddqbb612BU7UbmArXm57KA1yHWiZ5fBwHoIydSHprG8S9As4zBccoD5QLq0EyXP94WXBjNYj8eKFeCCR9AWzLX2lUWuU1i_YRKyCuDClPLcPxJiBtN2e_GpYQ May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: e281a5ed352441838b649ed98a4810df May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-VolumesNegativeTest-1585346643 May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:40:49.458943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:40:49.460206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e281a5ed352441838b649ed98a4810df", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e281a5ed352441838b649ed98a4810df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e281a5ed352441838b649ed98a4810df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e281a5ed352441838b649ed98a4810df"}]}] May 11 07:40:49.460206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-VolumesNegativeTest-1585346643 May 11 07:40:49.460206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: e281a5ed352441838b649ed98a4810df May 11 07:40:49.460206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-VolumesNegativeTest-1585346643 May 11 07:40:49.460206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-VolumesNegativeTest-1585346643-project May 11 07:40:49.460206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:40:49.460206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:40:49.460206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: 75e9fc22cd0942ceb526726e66baec29 May 11 07:40:49.460206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-VolumesNegativeTest-1585346643-project May 11 07:40:49.460206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:40:49.460206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 99693cf3-0e4b-48d0-ac99-eb076109897c could not be found. May 11 07:40:49.460206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '99693cf3-0e4b-48d0-ac99-eb076109897c'} May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99693cf3-0e4b-48d0-ac99-eb076109897c could not be found. May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:40:49.461074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99693cf3-0e4b-48d0-ac99-eb076109897c could not be found. May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99693cf3-0e4b-48d0-ac99-eb076109897c could not be found. May 11 07:40:49.462205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:40:49.463180 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b7e018c3-c0b7-4447-b2bf-3b182ae5497b tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] Returning 404 to user: Instance 99693cf3-0e4b-48d0-ac99-eb076109897c could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:40:49.463180 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-b7e018c3-c0b7-4447-b2bf-3b182ae5497b tempest-VolumesNegativeTest-1585346643 tempest-VolumesNegativeTest-1585346643-project] 10.222.0.36 "GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c" status: 404 len: 111 microversion: 2.1 time: 0.032267 May 11 07:40:49.466610 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 140/286] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:49 2022] GET /compute/v2.1/servers/99693cf3-0e4b-48d0-ac99-eb076109897c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:40:49.483789 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-6b76bb45-a797-44eb-87c1-77d3adda9ac2 req-8a00184b-fa4d-4f9f-97a3-1bf497f5b5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c3ef2c-456d-44de-805e-9011046e7b1a", "tag": "00030629-4c1b-478f-a74f-23f588ad9513"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:49.494690 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-6b76bb45-a797-44eb-87c1-77d3adda9ac2 req-8a00184b-fa4d-4f9f-97a3-1bf497f5b5a8 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:49.495711 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-6b76bb45-a797-44eb-87c1-77d3adda9ac2 req-8a00184b-fa4d-4f9f-97a3-1bf497f5b5a8 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:49.506974 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-6b76bb45-a797-44eb-87c1-77d3adda9ac2 req-8a00184b-fa4d-4f9f-97a3-1bf497f5b5a8 service nova] Creating event network-changed:00030629-4c1b-478f-a74f-23f588ad9513 for instance 40c3ef2c-456d-44de-805e-9011046e7b1a on hv-cinder-83699 May 11 07:40:49.511530 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-6b76bb45-a797-44eb-87c1-77d3adda9ac2 req-8a00184b-fa4d-4f9f-97a3-1bf497f5b5a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031816 May 11 07:40:49.512904 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 147/287] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:49.556209 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-6ff7e663-1690-4cfe-aba6-93b84310c38e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:49.563958 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6ff7e663-1690-4cfe-aba6-93b84310c38e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:49.564740 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6ff7e663-1690-4cfe-aba6-93b84310c38e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:49.626729 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-6ff7e663-1690-4cfe-aba6-93b84310c38e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Going to try to stop instance {{(pid=123600) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 11 07:40:49.669493 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-6ff7e663-1690-4cfe-aba6-93b84310c38e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "POST /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/action" status: 202 len: 0 microversion: 2.1 time: 0.117752 May 11 07:40:49.670204 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 141/288] 10.222.0.36 () {60 vars in 1277 bytes} [Wed May 11 07:40:49 2022] POST /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:40:49.673258 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d36e6f58-4a4d-4954-8fb9-9c2fc91f1e74 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:49.674002 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d36e6f58-4a4d-4954-8fb9-9c2fc91f1e74 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:49.678619 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e07fb779-1dd8-4df3-b5e9-c3e95f7f5355 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:49.679306 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e07fb779-1dd8-4df3-b5e9-c3e95f7f5355 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:49.680616 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d36e6f58-4a4d-4954-8fb9-9c2fc91f1e74 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:49.681067 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d36e6f58-4a4d-4954-8fb9-9c2fc91f1e74 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:49.681866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d36e6f58-4a4d-4954-8fb9-9c2fc91f1e74 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:49.682515 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d36e6f58-4a4d-4954-8fb9-9c2fc91f1e74 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:49.686167 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e07fb779-1dd8-4df3-b5e9-c3e95f7f5355 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:49.686657 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e07fb779-1dd8-4df3-b5e9-c3e95f7f5355 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:49.687437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e07fb779-1dd8-4df3-b5e9-c3e95f7f5355 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:49.687879 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e07fb779-1dd8-4df3-b5e9-c3e95f7f5355 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:49.877087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d36e6f58-4a4d-4954-8fb9-9c2fc91f1e74 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:49.881924 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e07fb779-1dd8-4df3-b5e9-c3e95f7f5355 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:49.887886 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d36e6f58-4a4d-4954-8fb9-9c2fc91f1e74 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:49.889441 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d36e6f58-4a4d-4954-8fb9-9c2fc91f1e74 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:49.890599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d36e6f58-4a4d-4954-8fb9-9c2fc91f1e74 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1743 microversion: 2.20 time: 0.222110 May 11 07:40:49.891152 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 148/289] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:49 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1743 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:49.891264 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e07fb779-1dd8-4df3-b5e9-c3e95f7f5355 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.216754 May 11 07:40:49.895882 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-52c7b021-af6f-4447-bcba-8f92894f44a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:49.896686 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-52c7b021-af6f-4447-bcba-8f92894f44a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:49.901704 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 142/290] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:49 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:40:49.903435 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-52c7b021-af6f-4447-bcba-8f92894f44a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:49.903885 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-52c7b021-af6f-4447-bcba-8f92894f44a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:49.904659 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-52c7b021-af6f-4447-bcba-8f92894f44a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:49.905095 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-52c7b021-af6f-4447-bcba-8f92894f44a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:50.040004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-52c7b021-af6f-4447-bcba-8f92894f44a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:50.049065 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-52c7b021-af6f-4447-bcba-8f92894f44a2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1313 microversion: 2.1 time: 0.156922 May 11 07:40:50.049846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 149/291] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:49 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:50.912562 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-53000b68-3b72-4c3c-8403-d7b858509f4e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:50.913842 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a5c934e2-d826-484c-a7ef-68472b85261c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:50.914439 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a5c934e2-d826-484c-a7ef-68472b85261c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:50.915041 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-53000b68-3b72-4c3c-8403-d7b858509f4e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:50.924132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-53000b68-3b72-4c3c-8403-d7b858509f4e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:50.924974 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-53000b68-3b72-4c3c-8403-d7b858509f4e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:50.926069 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-53000b68-3b72-4c3c-8403-d7b858509f4e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:50.926753 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-53000b68-3b72-4c3c-8403-d7b858509f4e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:50.937414 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5c934e2-d826-484c-a7ef-68472b85261c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:50.938119 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5c934e2-d826-484c-a7ef-68472b85261c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:50.939002 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5c934e2-d826-484c-a7ef-68472b85261c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:50.939538 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5c934e2-d826-484c-a7ef-68472b85261c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:51.246850 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-53000b68-3b72-4c3c-8403-d7b858509f4e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:51.262618 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-53000b68-3b72-4c3c-8403-d7b858509f4e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.355632 May 11 07:40:51.264157 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 150/292] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:50 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:51.277768 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-e469ff6c-1234-413c-a95c-252cca625bdd tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:51.278545 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-e469ff6c-1234-413c-a95c-252cca625bdd tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:51.285664 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e469ff6c-1234-413c-a95c-252cca625bdd tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:51.286390 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e469ff6c-1234-413c-a95c-252cca625bdd tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:51.288619 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e469ff6c-1234-413c-a95c-252cca625bdd tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:51.289797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e469ff6c-1234-413c-a95c-252cca625bdd tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:51.293423 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a5c934e2-d826-484c-a7ef-68472b85261c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:51.303838 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a5c934e2-d826-484c-a7ef-68472b85261c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:51.305347 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a5c934e2-d826-484c-a7ef-68472b85261c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:51.306714 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a5c934e2-d826-484c-a7ef-68472b85261c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1743 microversion: 2.20 time: 0.402323 May 11 07:40:51.307952 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 143/293] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:50 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1743 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:51.520231 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-e469ff6c-1234-413c-a95c-252cca625bdd tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:51.531884 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-e469ff6c-1234-413c-a95c-252cca625bdd tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1313 microversion: 2.1 time: 0.265531 May 11 07:40:51.532527 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 151/294] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:51 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:52.281203 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-0ad107e8-43f9-4f06-bb09-b3c5f7f330b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:52.281950 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-0ad107e8-43f9-4f06-bb09-b3c5f7f330b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:52.296513 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0ad107e8-43f9-4f06-bb09-b3c5f7f330b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:52.302105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0ad107e8-43f9-4f06-bb09-b3c5f7f330b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:52.303180 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0ad107e8-43f9-4f06-bb09-b3c5f7f330b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:52.303698 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0ad107e8-43f9-4f06-bb09-b3c5f7f330b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:52.318384 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-566705206", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-678948032", "security_groups": [{"name": "tempest-secgroup-smoke-402851186"}], "block_device_mapping_v2": [{"uuid": "b55a0a72-0237-4c3e-8b13-a608bc854c55", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "55b96101-3633-4a8d-a623-73556fb91d7c"}]}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:52.534033 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0ad107e8-43f9-4f06-bb09-b3c5f7f330b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:52.545374 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-0ad107e8-43f9-4f06-bb09-b3c5f7f330b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.265402 May 11 07:40:52.546033 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 144/295] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:52 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:52.554435 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8c05a6ca-ee61-4f94-a552-8f8f83f2bdf5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:52.555031 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8c05a6ca-ee61-4f94-a552-8f8f83f2bdf5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:52.559614 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.network.neutron [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] validate_networks() for [('55b96101-3633-4a8d-a623-73556fb91d7c', None, None, None, None, None)] {{(pid=123599) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:40:52.568683 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8c05a6ca-ee61-4f94-a552-8f8f83f2bdf5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:52.569332 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8c05a6ca-ee61-4f94-a552-8f8f83f2bdf5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:52.570681 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8c05a6ca-ee61-4f94-a552-8f8f83f2bdf5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:52.571281 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8c05a6ca-ee61-4f94-a552-8f8f83f2bdf5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:52.856432 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8c05a6ca-ee61-4f94-a552-8f8f83f2bdf5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:52.887749 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8c05a6ca-ee61-4f94-a552-8f8f83f2bdf5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:52.889287 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8c05a6ca-ee61-4f94-a552-8f8f83f2bdf5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:52.890510 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8c05a6ca-ee61-4f94-a552-8f8f83f2bdf5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1738 microversion: 2.20 time: 0.339940 May 11 07:40:52.891434 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 145/296] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:52 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1738 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:52.895914 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d546bd6e-b795-49ff-8679-5d76aaed00eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:52.896523 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d546bd6e-b795-49ff-8679-5d76aaed00eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:52.907214 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d546bd6e-b795-49ff-8679-5d76aaed00eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:52.907602 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d546bd6e-b795-49ff-8679-5d76aaed00eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:52.908452 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d546bd6e-b795-49ff-8679-5d76aaed00eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:52.909070 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d546bd6e-b795-49ff-8679-5d76aaed00eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:53.153409 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d546bd6e-b795-49ff-8679-5d76aaed00eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:53.165319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d546bd6e-b795-49ff-8679-5d76aaed00eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1313 microversion: 2.1 time: 0.272770 May 11 07:40:53.166216 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 146/297] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:52 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:53.170262 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Flavor limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:40:53.170791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Image limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:40:53.171385 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Flavor pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:40:53.171893 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Image pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:40:53.172404 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:40:53.183780 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:53.184371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:53.185246 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:53.185778 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:53.205256 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Getting quotas for project d69ae02f1e0146c795d799160ac17d44. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:40:53.210180 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Getting quotas for user ed2dae16f03c4eff9185087ed50120fc and project d69ae02f1e0146c795d799160ac17d44. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:40:53.270220 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Going to run 1 instances... {{(pid=123599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:40:53.272361 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b55a0a72-0237-4c3e-8b13-a608bc854c55',volume_size=None,volume_type=None)] {{(pid=123599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:40:53.426659 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-b4cd1a60-7e66-4894-9d4f-2dd26e4710f9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.115686 May 11 07:40:53.427410 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 152/298] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:40:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:40:53.439750 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7576faeb-b0f1-4eac-9b82-374e9af139fa tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:53.441038 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7576faeb-b0f1-4eac-9b82-374e9af139fa tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:53.516929 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7576faeb-b0f1-4eac-9b82-374e9af139fa tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:53.524294 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7576faeb-b0f1-4eac-9b82-374e9af139fa tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1093 microversion: 2.1 time: 0.090585 May 11 07:40:53.534225 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 147/299] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:53 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1093 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:53.564481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a9b86db8-b49f-4823-b31a-94ac12056d76 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:53.565359 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a9b86db8-b49f-4823-b31a-94ac12056d76 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:53.572341 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a9b86db8-b49f-4823-b31a-94ac12056d76 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:53.572857 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a9b86db8-b49f-4823-b31a-94ac12056d76 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:53.574280 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a9b86db8-b49f-4823-b31a-94ac12056d76 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:53.575186 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a9b86db8-b49f-4823-b31a-94ac12056d76 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:53.736423 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a9b86db8-b49f-4823-b31a-94ac12056d76 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:53.747869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a9b86db8-b49f-4823-b31a-94ac12056d76 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.189133 May 11 07:40:53.762207 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 153/300] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:53 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:53.911004 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-feee2030-0eef-45fd-a70f-bf5f72b1fbb0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:53.918747 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-feee2030-0eef-45fd-a70f-bf5f72b1fbb0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:53.942241 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-feee2030-0eef-45fd-a70f-bf5f72b1fbb0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:53.943180 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-feee2030-0eef-45fd-a70f-bf5f72b1fbb0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:53.944379 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-feee2030-0eef-45fd-a70f-bf5f72b1fbb0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:53.945042 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-feee2030-0eef-45fd-a70f-bf5f72b1fbb0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:54.140854 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-feee2030-0eef-45fd-a70f-bf5f72b1fbb0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:54.149478 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-feee2030-0eef-45fd-a70f-bf5f72b1fbb0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:54.151411 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-feee2030-0eef-45fd-a70f-bf5f72b1fbb0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:54.152829 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-feee2030-0eef-45fd-a70f-bf5f72b1fbb0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1738 microversion: 2.20 time: 0.245881 May 11 07:40:54.153932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 148/301] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:53 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:54.184093 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-720a326f-030c-46f2-88e1-a4fb139ed04a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:54.187305 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-720a326f-030c-46f2-88e1-a4fb139ed04a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:54.195046 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-720a326f-030c-46f2-88e1-a4fb139ed04a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:54.195733 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-720a326f-030c-46f2-88e1-a4fb139ed04a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:54.197323 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-720a326f-030c-46f2-88e1-a4fb139ed04a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:54.197981 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-720a326f-030c-46f2-88e1-a4fb139ed04a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:54.357795 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-720a326f-030c-46f2-88e1-a4fb139ed04a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:54.366590 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-720a326f-030c-46f2-88e1-a4fb139ed04a tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1313 microversion: 2.1 time: 0.187617 May 11 07:40:54.367810 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 154/302] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:54 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:54.544397 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9ea3fa4e-b56f-440b-8fbf-a08c9e012b38 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:54.545371 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9ea3fa4e-b56f-440b-8fbf-a08c9e012b38 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:54.562982 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9ea3fa4e-b56f-440b-8fbf-a08c9e012b38 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:54.564060 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9ea3fa4e-b56f-440b-8fbf-a08c9e012b38 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:54.564959 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9ea3fa4e-b56f-440b-8fbf-a08c9e012b38 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:54.568846 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9ea3fa4e-b56f-440b-8fbf-a08c9e012b38 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:54.767887 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-355f33db-509a-47d1-811e-0296a284c0f5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:54.769322 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-355f33db-509a-47d1-811e-0296a284c0f5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:54.778922 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-355f33db-509a-47d1-811e-0296a284c0f5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:54.782521 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-355f33db-509a-47d1-811e-0296a284c0f5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:54.783845 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-355f33db-509a-47d1-811e-0296a284c0f5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:54.784502 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-355f33db-509a-47d1-811e-0296a284c0f5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:54.822521 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9ea3fa4e-b56f-440b-8fbf-a08c9e012b38 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:54.831972 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9ea3fa4e-b56f-440b-8fbf-a08c9e012b38 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1191 microversion: 2.1 time: 0.295278 May 11 07:40:54.832477 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 149/303] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:54 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1191 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:55.145836 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-355f33db-509a-47d1-811e-0296a284c0f5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:55.163533 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-355f33db-509a-47d1-811e-0296a284c0f5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.400094 May 11 07:40:55.164575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 155/304] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:54 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:55.172732 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-0e5a5da4-307a-4171-8992-5197dc8fc5f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:55.173654 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-0e5a5da4-307a-4171-8992-5197dc8fc5f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:55.196802 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0e5a5da4-307a-4171-8992-5197dc8fc5f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:55.199201 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0e5a5da4-307a-4171-8992-5197dc8fc5f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:55.201523 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0e5a5da4-307a-4171-8992-5197dc8fc5f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:55.204332 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0e5a5da4-307a-4171-8992-5197dc8fc5f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:55.386171 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d6e45f52-66d6-4228-bae9-63703e3cf2c2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:55.387482 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d6e45f52-66d6-4228-bae9-63703e3cf2c2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:55.396320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d6e45f52-66d6-4228-bae9-63703e3cf2c2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:55.397034 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d6e45f52-66d6-4228-bae9-63703e3cf2c2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:55.398028 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d6e45f52-66d6-4228-bae9-63703e3cf2c2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:55.398459 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d6e45f52-66d6-4228-bae9-63703e3cf2c2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:55.544494 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0e5a5da4-307a-4171-8992-5197dc8fc5f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:55.569618 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0e5a5da4-307a-4171-8992-5197dc8fc5f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:55.571353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0e5a5da4-307a-4171-8992-5197dc8fc5f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:55.573423 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-0e5a5da4-307a-4171-8992-5197dc8fc5f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1738 microversion: 2.20 time: 0.404742 May 11 07:40:55.574663 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 150/305] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:55 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1738 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:55.768057 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d6e45f52-66d6-4228-bae9-63703e3cf2c2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:55.780636 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d6e45f52-66d6-4228-bae9-63703e3cf2c2 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1313 microversion: 2.1 time: 0.395203 May 11 07:40:55.780636 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 156/306] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:55 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:40:55.851155 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-90a95f02-60f2-4045-aef6-5027ac0f7fc6 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:55.852160 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-90a95f02-60f2-4045-aef6-5027ac0f7fc6 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:55.859114 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-90a95f02-60f2-4045-aef6-5027ac0f7fc6 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:55.859912 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-90a95f02-60f2-4045-aef6-5027ac0f7fc6 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:55.861047 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-90a95f02-60f2-4045-aef6-5027ac0f7fc6 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:55.862008 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-90a95f02-60f2-4045-aef6-5027ac0f7fc6 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:55.970179 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-90a95f02-60f2-4045-aef6-5027ac0f7fc6 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:55.986099 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-90a95f02-60f2-4045-aef6-5027ac0f7fc6 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1197 microversion: 2.1 time: 0.138928 May 11 07:40:55.987283 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 151/307] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:55 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:56.184703 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2ce74d6f-537a-49ed-8483-f3240a8bd45f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:56.185398 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2ce74d6f-537a-49ed-8483-f3240a8bd45f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:56.208066 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2ce74d6f-537a-49ed-8483-f3240a8bd45f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:56.209223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2ce74d6f-537a-49ed-8483-f3240a8bd45f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:56.210423 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2ce74d6f-537a-49ed-8483-f3240a8bd45f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:56.210890 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2ce74d6f-537a-49ed-8483-f3240a8bd45f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:56.583044 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-421e35eb-cfa6-441a-b550-f32e3ea3efeb req-af2c104a-cf15-48c0-89bd-ad1a9245937e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c3ef2c-456d-44de-805e-9011046e7b1a", "name": "network-vif-plugged", "status": "completed", "tag": "00030629-4c1b-478f-a74f-23f588ad9513"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:56.612575 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-421e35eb-cfa6-441a-b550-f32e3ea3efeb req-af2c104a-cf15-48c0-89bd-ad1a9245937e service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:56.613297 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-421e35eb-cfa6-441a-b550-f32e3ea3efeb req-af2c104a-cf15-48c0-89bd-ad1a9245937e service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:56.634608 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-421e35eb-cfa6-441a-b550-f32e3ea3efeb req-af2c104a-cf15-48c0-89bd-ad1a9245937e service nova] Creating event network-vif-plugged:00030629-4c1b-478f-a74f-23f588ad9513 for instance 40c3ef2c-456d-44de-805e-9011046e7b1a on hv-cinder-83699 May 11 07:40:56.641306 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2ce74d6f-537a-49ed-8483-f3240a8bd45f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:56.648882 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-421e35eb-cfa6-441a-b550-f32e3ea3efeb req-af2c104a-cf15-48c0-89bd-ad1a9245937e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066684 May 11 07:40:56.649740 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 152/308] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:40:56.661709 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-27ac09d4-6514-4deb-9bf1-58924aff9893 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:56.668132 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-27ac09d4-6514-4deb-9bf1-58924aff9893 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:56.676311 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-27ac09d4-6514-4deb-9bf1-58924aff9893 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:56.679208 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-27ac09d4-6514-4deb-9bf1-58924aff9893 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:56.680290 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-27ac09d4-6514-4deb-9bf1-58924aff9893 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:56.681091 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-27ac09d4-6514-4deb-9bf1-58924aff9893 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:56.682048 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2ce74d6f-537a-49ed-8483-f3240a8bd45f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.489262 May 11 07:40:56.704157 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 157/309] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:56 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:56.801916 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-e7ba9960-be83-47bf-804d-cc68653269eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:56.803366 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-e7ba9960-be83-47bf-804d-cc68653269eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:56.810347 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e7ba9960-be83-47bf-804d-cc68653269eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:56.812149 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e7ba9960-be83-47bf-804d-cc68653269eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:56.813336 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e7ba9960-be83-47bf-804d-cc68653269eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:56.814067 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e7ba9960-be83-47bf-804d-cc68653269eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:57.079032 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-27ac09d4-6514-4deb-9bf1-58924aff9893 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:57.091842 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-27ac09d4-6514-4deb-9bf1-58924aff9893 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:57.093956 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-27ac09d4-6514-4deb-9bf1-58924aff9893 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:57.096415 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-27ac09d4-6514-4deb-9bf1-58924aff9893 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1738 microversion: 2.20 time: 0.438724 May 11 07:40:57.097236 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 153/310] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:56 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1738 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:57.102610 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-06973707-f725-46a8-867e-08aea80550af tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:57.104037 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-06973707-f725-46a8-867e-08aea80550af tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:57.119834 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-06973707-f725-46a8-867e-08aea80550af tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:57.120288 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-06973707-f725-46a8-867e-08aea80550af tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:57.121080 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-06973707-f725-46a8-867e-08aea80550af tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:57.121520 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-06973707-f725-46a8-867e-08aea80550af tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:57.134023 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-e7ba9960-be83-47bf-804d-cc68653269eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:57.148799 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-e7ba9960-be83-47bf-804d-cc68653269eb tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1313 microversion: 2.1 time: 0.354620 May 11 07:40:57.149513 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 158/311] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:56 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:40:57.352982 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-06973707-f725-46a8-867e-08aea80550af tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:57.366283 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-06973707-f725-46a8-867e-08aea80550af tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.267801 May 11 07:40:57.367463 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 154/312] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:57 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:57.702826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-e8033544-9dda-42ee-bcbd-f28b4842cef4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:57.703712 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-e8033544-9dda-42ee-bcbd-f28b4842cef4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:57.715447 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e8033544-9dda-42ee-bcbd-f28b4842cef4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:57.716790 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e8033544-9dda-42ee-bcbd-f28b4842cef4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:57.717791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e8033544-9dda-42ee-bcbd-f28b4842cef4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:57.718388 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e8033544-9dda-42ee-bcbd-f28b4842cef4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:57.760129 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-5904de7d-ab4a-4551-a7c5-81e3cbf4c640 req-b3f64d1f-419a-42bb-bd8f-f8c2659cb1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0", "tag": "984a3ee7-17e5-4143-9062-ba7a44b7d5ad"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:40:57.772844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-5904de7d-ab4a-4551-a7c5-81e3cbf4c640 req-b3f64d1f-419a-42bb-bd8f-f8c2659cb1a5 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:57.773530 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-5904de7d-ab4a-4551-a7c5-81e3cbf4c640 req-b3f64d1f-419a-42bb-bd8f-f8c2659cb1a5 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:57.787871 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-5904de7d-ab4a-4551-a7c5-81e3cbf4c640 req-b3f64d1f-419a-42bb-bd8f-f8c2659cb1a5 service nova] Creating event network-changed:984a3ee7-17e5-4143-9062-ba7a44b7d5ad for instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 on hv-cinder-83699 May 11 07:40:57.794187 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-5904de7d-ab4a-4551-a7c5-81e3cbf4c640 req-b3f64d1f-419a-42bb-bd8f-f8c2659cb1a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037684 May 11 07:40:57.795386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 155/313] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:40:57.929098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-e8033544-9dda-42ee-bcbd-f28b4842cef4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:57.946473 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-e8033544-9dda-42ee-bcbd-f28b4842cef4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.247763 May 11 07:40:57.947716 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 159/314] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:57 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:58.126855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ec144d7d-7e02-485a-a957-29e22c1315f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:58.127654 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-ec144d7d-7e02-485a-a957-29e22c1315f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:58.134546 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ec144d7d-7e02-485a-a957-29e22c1315f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:58.136311 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ec144d7d-7e02-485a-a957-29e22c1315f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:58.138344 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ec144d7d-7e02-485a-a957-29e22c1315f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:58.138858 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ec144d7d-7e02-485a-a957-29e22c1315f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:58.174879 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-84575af3-4d33-4c54-bcc2-e7cc21ecacac tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:58.175750 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-84575af3-4d33-4c54-bcc2-e7cc21ecacac tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:58.186945 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84575af3-4d33-4c54-bcc2-e7cc21ecacac tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:58.187398 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84575af3-4d33-4c54-bcc2-e7cc21ecacac tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:58.188194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84575af3-4d33-4c54-bcc2-e7cc21ecacac tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:58.188632 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84575af3-4d33-4c54-bcc2-e7cc21ecacac tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:58.429932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-ec144d7d-7e02-485a-a957-29e22c1315f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:58.433332 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-84575af3-4d33-4c54-bcc2-e7cc21ecacac tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:58.442019 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-ec144d7d-7e02-485a-a957-29e22c1315f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:58.442840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-84575af3-4d33-4c54-bcc2-e7cc21ecacac tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1313 microversion: 2.1 time: 0.276505 May 11 07:40:58.443718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-ec144d7d-7e02-485a-a957-29e22c1315f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:58.449581 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-ec144d7d-7e02-485a-a957-29e22c1315f7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1738 microversion: 2.20 time: 0.322469 May 11 07:40:58.449759 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 160/315] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:58 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:58.449862 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 156/316] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:58 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1738 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:40:58.457716 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-205efc5c-c8ba-40da-9481-163bda81b070 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:58.457716 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-205efc5c-c8ba-40da-9481-163bda81b070 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:58.463699 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-205efc5c-c8ba-40da-9481-163bda81b070 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:58.464224 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-205efc5c-c8ba-40da-9481-163bda81b070 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:58.464992 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-205efc5c-c8ba-40da-9481-163bda81b070 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:58.467361 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-205efc5c-c8ba-40da-9481-163bda81b070 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:58.607008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-205efc5c-c8ba-40da-9481-163bda81b070 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:58.620333 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-205efc5c-c8ba-40da-9481-163bda81b070 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.171104 May 11 07:40:58.620947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 161/317] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:58 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:58.964920 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-de10c348-f4c9-4646-9451-fc2f1db14f5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:58.965566 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-de10c348-f4c9-4646-9451-fc2f1db14f5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:58.977140 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-de10c348-f4c9-4646-9451-fc2f1db14f5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:58.983236 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-de10c348-f4c9-4646-9451-fc2f1db14f5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:58.984548 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-de10c348-f4c9-4646-9451-fc2f1db14f5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:58.985174 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-de10c348-f4c9-4646-9451-fc2f1db14f5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:59.252047 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-de10c348-f4c9-4646-9451-fc2f1db14f5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:59.263233 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-de10c348-f4c9-4646-9451-fc2f1db14f5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.302688 May 11 07:40:59.264131 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 157/318] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:58 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:59.460916 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-857a24d6-1701-41e6-a48a-67d672ca06cc tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:59.462357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-857a24d6-1701-41e6-a48a-67d672ca06cc tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:59.464010 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7a460fb2-ad23-40c4-89da-edfb24176191 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:59.464631 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7a460fb2-ad23-40c4-89da-edfb24176191 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:59.469477 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-857a24d6-1701-41e6-a48a-67d672ca06cc tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:59.473757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-857a24d6-1701-41e6-a48a-67d672ca06cc tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:59.474649 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-857a24d6-1701-41e6-a48a-67d672ca06cc tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:59.475166 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-857a24d6-1701-41e6-a48a-67d672ca06cc tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:59.478437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7a460fb2-ad23-40c4-89da-edfb24176191 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:59.478903 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7a460fb2-ad23-40c4-89da-edfb24176191 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:59.485994 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7a460fb2-ad23-40c4-89da-edfb24176191 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:59.485994 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7a460fb2-ad23-40c4-89da-edfb24176191 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:59.719387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7a460fb2-ad23-40c4-89da-edfb24176191 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:59.731162 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-857a24d6-1701-41e6-a48a-67d672ca06cc tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:59.742236 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-857a24d6-1701-41e6-a48a-67d672ca06cc tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1497 microversion: 2.1 time: 0.284313 May 11 07:40:59.747547 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7a460fb2-ad23-40c4-89da-edfb24176191 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:59.747836 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 162/319] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:59 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1497 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:40:59.752628 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-5da82c7b-c225-4aa6-b44e-60aedc0523c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:40:59.754457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7a460fb2-ad23-40c4-89da-edfb24176191 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:59.755815 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7a460fb2-ad23-40c4-89da-edfb24176191 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1738 microversion: 2.20 time: 0.295499 May 11 07:40:59.756566 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 158/320] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:40:59 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1738 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 07:40:59.756973 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-5da82c7b-c225-4aa6-b44e-60aedc0523c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:40:59.764056 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5da82c7b-c225-4aa6-b44e-60aedc0523c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:59.764730 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5da82c7b-c225-4aa6-b44e-60aedc0523c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:59.765749 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5da82c7b-c225-4aa6-b44e-60aedc0523c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:40:59.766388 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5da82c7b-c225-4aa6-b44e-60aedc0523c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:40:59.926865 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-5da82c7b-c225-4aa6-b44e-60aedc0523c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:40:59.947010 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-5da82c7b-c225-4aa6-b44e-60aedc0523c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.197695 May 11 07:40:59.948725 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 163/321] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:40:59 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:00.266677 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-6e2c234b-c118-412a-8e31-f1b843df3f17 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:00.267243 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-6e2c234b-c118-412a-8e31-f1b843df3f17 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:00.274144 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6e2c234b-c118-412a-8e31-f1b843df3f17 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:00.274586 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6e2c234b-c118-412a-8e31-f1b843df3f17 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:00.280968 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-9be1ef46-8122-4d5e-b76d-881386bf2ffe tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:00.281602 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-9be1ef46-8122-4d5e-b76d-881386bf2ffe tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:00.283467 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6e2c234b-c118-412a-8e31-f1b843df3f17 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:00.283982 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6e2c234b-c118-412a-8e31-f1b843df3f17 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:00.287795 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9be1ef46-8122-4d5e-b76d-881386bf2ffe tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:00.288254 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9be1ef46-8122-4d5e-b76d-881386bf2ffe tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:00.289032 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9be1ef46-8122-4d5e-b76d-881386bf2ffe tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:00.289470 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9be1ef46-8122-4d5e-b76d-881386bf2ffe tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:00.312512 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-6e2c234b-c118-412a-8e31-f1b843df3f17 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Going to try to terminate instance {{(pid=123600) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:41:00.407114 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-6e2c234b-c118-412a-8e31-f1b843df3f17 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "DELETE /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 204 len: 0 microversion: 2.1 time: 0.143505 May 11 07:41:00.407698 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 159/322] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:41:00 2022] DELETE /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:41:00.419813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-660054ad-ae1b-437f-87f3-90628d4bb898 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:00.420801 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-660054ad-ae1b-437f-87f3-90628d4bb898 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:00.436237 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-660054ad-ae1b-437f-87f3-90628d4bb898 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:00.437054 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-660054ad-ae1b-437f-87f3-90628d4bb898 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:00.438242 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-660054ad-ae1b-437f-87f3-90628d4bb898 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:00.439326 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-660054ad-ae1b-437f-87f3-90628d4bb898 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:00.448680 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-9be1ef46-8122-4d5e-b76d-881386bf2ffe tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:00.456792 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-9be1ef46-8122-4d5e-b76d-881386bf2ffe tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.180574 May 11 07:41:00.467951 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 164/323] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:00 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:00.597278 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-660054ad-ae1b-437f-87f3-90628d4bb898 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:00.605383 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-660054ad-ae1b-437f-87f3-90628d4bb898 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1503 microversion: 2.1 time: 0.190686 May 11 07:41:00.614482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 160/324] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:00 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:00.774715 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ff4dd4fa-adb9-4f44-9f69-3552f9c336d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:00.775739 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ff4dd4fa-adb9-4f44-9f69-3552f9c336d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:00.783405 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ff4dd4fa-adb9-4f44-9f69-3552f9c336d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:00.783947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ff4dd4fa-adb9-4f44-9f69-3552f9c336d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:00.784809 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ff4dd4fa-adb9-4f44-9f69-3552f9c336d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:00.785515 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ff4dd4fa-adb9-4f44-9f69-3552f9c336d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:00.928886 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ff4dd4fa-adb9-4f44-9f69-3552f9c336d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:00.937139 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ff4dd4fa-adb9-4f44-9f69-3552f9c336d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:00.938947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ff4dd4fa-adb9-4f44-9f69-3552f9c336d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:00.940104 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ff4dd4fa-adb9-4f44-9f69-3552f9c336d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1738 microversion: 2.20 time: 0.169525 May 11 07:41:00.940901 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 165/325] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:00 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:00.965514 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5165629b-7fa6-4695-931e-b8a618e50fa2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:00.966163 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-5165629b-7fa6-4695-931e-b8a618e50fa2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:00.972411 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5165629b-7fa6-4695-931e-b8a618e50fa2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:00.972868 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5165629b-7fa6-4695-931e-b8a618e50fa2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:00.973691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5165629b-7fa6-4695-931e-b8a618e50fa2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:00.974136 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5165629b-7fa6-4695-931e-b8a618e50fa2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:01.124365 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-5165629b-7fa6-4695-931e-b8a618e50fa2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:01.132115 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-5165629b-7fa6-4695-931e-b8a618e50fa2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.171052 May 11 07:41:01.132795 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 161/326] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:00 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:01.487065 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2e0e5da8-55fd-4772-bed8-d062c872c351 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:01.487707 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2e0e5da8-55fd-4772-bed8-d062c872c351 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:01.494101 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2e0e5da8-55fd-4772-bed8-d062c872c351 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:01.495397 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2e0e5da8-55fd-4772-bed8-d062c872c351 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:01.496297 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2e0e5da8-55fd-4772-bed8-d062c872c351 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:01.496926 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2e0e5da8-55fd-4772-bed8-d062c872c351 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:01.634588 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c591d9fa-bf6b-4e59-af1f-631709e712be tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:01.635882 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c591d9fa-bf6b-4e59-af1f-631709e712be tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:01.637931 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2e0e5da8-55fd-4772-bed8-d062c872c351 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:01.647947 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c591d9fa-bf6b-4e59-af1f-631709e712be tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:01.648444 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c591d9fa-bf6b-4e59-af1f-631709e712be tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:01.649263 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c591d9fa-bf6b-4e59-af1f-631709e712be tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:01.650151 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c591d9fa-bf6b-4e59-af1f-631709e712be tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:01.651821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2e0e5da8-55fd-4772-bed8-d062c872c351 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.170038 May 11 07:41:01.652901 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 166/327] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:01 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:01.790734 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c591d9fa-bf6b-4e59-af1f-631709e712be tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:01.800195 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c591d9fa-bf6b-4e59-af1f-631709e712be tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1503 microversion: 2.1 time: 0.181414 May 11 07:41:01.800869 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 162/328] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:01 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:01.964084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-73ac9dfd-b686-430a-a98c-7e51d4ad93f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:01.965282 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-73ac9dfd-b686-430a-a98c-7e51d4ad93f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:01.972410 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-73ac9dfd-b686-430a-a98c-7e51d4ad93f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:01.973016 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-73ac9dfd-b686-430a-a98c-7e51d4ad93f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:01.973832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-73ac9dfd-b686-430a-a98c-7e51d4ad93f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:01.974298 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-73ac9dfd-b686-430a-a98c-7e51d4ad93f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:02.149176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3b96f772-f789-4f18-bc38-23481a74d204 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:02.149838 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3b96f772-f789-4f18-bc38-23481a74d204 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:02.156148 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3b96f772-f789-4f18-bc38-23481a74d204 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:02.156596 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3b96f772-f789-4f18-bc38-23481a74d204 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:02.157361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3b96f772-f789-4f18-bc38-23481a74d204 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:02.157824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3b96f772-f789-4f18-bc38-23481a74d204 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:02.190006 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-73ac9dfd-b686-430a-a98c-7e51d4ad93f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:02.198333 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-73ac9dfd-b686-430a-a98c-7e51d4ad93f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:02.199829 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-73ac9dfd-b686-430a-a98c-7e51d4ad93f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:02.200967 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-73ac9dfd-b686-430a-a98c-7e51d4ad93f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1738 microversion: 2.20 time: 0.244239 May 11 07:41:02.201529 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 167/329] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:01 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 07:41:02.380000 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3b96f772-f789-4f18-bc38-23481a74d204 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:02.387598 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3b96f772-f789-4f18-bc38-23481a74d204 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.242252 May 11 07:41:02.388159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 163/330] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:02 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:02.553421 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-82418026-d166-4a5c-bcf4-d93ef924f60a req-c9bf9566-0c4f-402a-bbce-4b741de5a454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c3ef2c-456d-44de-805e-9011046e7b1a", "name": "network-vif-deleted", "tag": "00030629-4c1b-478f-a74f-23f588ad9513"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:41:02.562387 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-82418026-d166-4a5c-bcf4-d93ef924f60a req-c9bf9566-0c4f-402a-bbce-4b741de5a454 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:02.562883 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-82418026-d166-4a5c-bcf4-d93ef924f60a req-c9bf9566-0c4f-402a-bbce-4b741de5a454 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:02.576267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-82418026-d166-4a5c-bcf4-d93ef924f60a req-c9bf9566-0c4f-402a-bbce-4b741de5a454 service nova] Creating event network-vif-deleted:00030629-4c1b-478f-a74f-23f588ad9513 for instance 40c3ef2c-456d-44de-805e-9011046e7b1a on hv-cinder-83699 May 11 07:41:02.581519 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-82418026-d166-4a5c-bcf4-d93ef924f60a req-c9bf9566-0c4f-402a-bbce-4b741de5a454 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031867 May 11 07:41:02.582175 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 168/331] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:41:02.668034 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-311b2848-add3-4a0d-8b32-a17691e7d9b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:02.668651 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-311b2848-add3-4a0d-8b32-a17691e7d9b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:02.675407 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-311b2848-add3-4a0d-8b32-a17691e7d9b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:02.675857 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-311b2848-add3-4a0d-8b32-a17691e7d9b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:02.676621 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-311b2848-add3-4a0d-8b32-a17691e7d9b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:02.677051 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-311b2848-add3-4a0d-8b32-a17691e7d9b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:02.818727 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-cf4e232d-1b14-4c91-bf6c-25f71d22a2e5 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:02.819423 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-cf4e232d-1b14-4c91-bf6c-25f71d22a2e5 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:02.826116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cf4e232d-1b14-4c91-bf6c-25f71d22a2e5 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:02.826566 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cf4e232d-1b14-4c91-bf6c-25f71d22a2e5 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:02.827331 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cf4e232d-1b14-4c91-bf6c-25f71d22a2e5 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:02.827772 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cf4e232d-1b14-4c91-bf6c-25f71d22a2e5 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:02.837878 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-311b2848-add3-4a0d-8b32-a17691e7d9b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:02.845711 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-311b2848-add3-4a0d-8b32-a17691e7d9b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.181439 May 11 07:41:02.846285 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 164/332] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:02 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:02.857423 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cf4e232d-1b14-4c91-bf6c-25f71d22a2e5 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:02.857911 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cf4e232d-1b14-4c91-bf6c-25f71d22a2e5 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:02.858359 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.objects.instance [None req-cf4e232d-1b14-4c91-bf6c-25f71d22a2e5 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lazy-loading 'fault' on Instance uuid 40c3ef2c-456d-44de-805e-9011046e7b1a {{(pid=123599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:41:02.900873 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-cf4e232d-1b14-4c91-bf6c-25f71d22a2e5 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3cf6ced4ed4d4e87cb9934f020b055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e0fc25f309475d83688bab2b138157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:02.907942 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-cf4e232d-1b14-4c91-bf6c-25f71d22a2e5 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 200 len: 1303 microversion: 2.1 time: 0.093670 May 11 07:41:02.908497 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 169/333] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:02 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:41:03.218516 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9540f520-5a91-41d7-b91e-cb71da6a4494 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:03.219150 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9540f520-5a91-41d7-b91e-cb71da6a4494 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:03.225053 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9540f520-5a91-41d7-b91e-cb71da6a4494 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:03.225503 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9540f520-5a91-41d7-b91e-cb71da6a4494 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:03.226300 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9540f520-5a91-41d7-b91e-cb71da6a4494 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:03.226737 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9540f520-5a91-41d7-b91e-cb71da6a4494 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:03.404920 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-4d3a1b42-41e6-45a0-81a0-5c52f3c0d5a8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:03.405720 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-4d3a1b42-41e6-45a0-81a0-5c52f3c0d5a8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:03.411563 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4d3a1b42-41e6-45a0-81a0-5c52f3c0d5a8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:03.412077 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4d3a1b42-41e6-45a0-81a0-5c52f3c0d5a8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:03.412833 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4d3a1b42-41e6-45a0-81a0-5c52f3c0d5a8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:03.413264 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4d3a1b42-41e6-45a0-81a0-5c52f3c0d5a8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:03.435882 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9540f520-5a91-41d7-b91e-cb71da6a4494 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:03.444131 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9540f520-5a91-41d7-b91e-cb71da6a4494 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:03.445803 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9540f520-5a91-41d7-b91e-cb71da6a4494 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:03.447110 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9540f520-5a91-41d7-b91e-cb71da6a4494 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1720 microversion: 2.20 time: 0.232560 May 11 07:41:03.447763 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 165/334] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:03 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:03.622566 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-4d3a1b42-41e6-45a0-81a0-5c52f3c0d5a8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:03.630812 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-4d3a1b42-41e6-45a0-81a0-5c52f3c0d5a8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.230373 May 11 07:41:03.631367 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 170/335] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:03 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:41:03.862601 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1f6273a4-180d-41e8-a776-19f501bd6f5f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:03.863121 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-1f6273a4-180d-41e8-a776-19f501bd6f5f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:03.869402 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1f6273a4-180d-41e8-a776-19f501bd6f5f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:03.869886 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1f6273a4-180d-41e8-a776-19f501bd6f5f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:03.870644 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1f6273a4-180d-41e8-a776-19f501bd6f5f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:03.871073 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1f6273a4-180d-41e8-a776-19f501bd6f5f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:03.925530 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b17934fd-12a0-4ade-b4a0-c58257e32521 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:03.926303 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-b17934fd-12a0-4ade-b4a0-c58257e32521 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] [instance: 40c3ef2c-456d-44de-805e-9011046e7b1a] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:03.932536 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b17934fd-12a0-4ade-b4a0-c58257e32521 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:03.932984 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b17934fd-12a0-4ade-b4a0-c58257e32521 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:03.933789 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b17934fd-12a0-4ade-b4a0-c58257e32521 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:03.934227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b17934fd-12a0-4ade-b4a0-c58257e32521 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:03.948532 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-b17934fd-12a0-4ade-b4a0-c58257e32521 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] HTTP exception thrown: Instance 40c3ef2c-456d-44de-805e-9011046e7b1a could not be found. May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b17934fd-12a0-4ade-b4a0-c58257e32521 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Request method failure captured: May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a HTTP/1.1 May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2hgc9_LvcDjMUIcnwbN_GoQ9x8FbyTUXMcFoK-Ojq63MAFmcMUNE9HdsDr5SIAXebQ71FgJj2NnB_naNyGsrSYWL54JcIcbT5MIOweyzQL-KWgTYJVpEeeAVlFx2kJUuGPUWTN80plVOhyLC88Gp3Cyin80hLmm7-8vByhVuVXcocE May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 70e0fc25f309475d83688bab2b138157 May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-VolumesActionsTest-1045756326 May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:41:03.950949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:41:03.952321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_70e0fc25f309475d83688bab2b138157", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/70e0fc25f309475d83688bab2b138157"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/70e0fc25f309475d83688bab2b138157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/70e0fc25f309475d83688bab2b138157"}]}] May 11 07:41:03.952321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-VolumesActionsTest-1045756326 May 11 07:41:03.952321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 70e0fc25f309475d83688bab2b138157 May 11 07:41:03.952321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-VolumesActionsTest-1045756326 May 11 07:41:03.952321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-VolumesActionsTest-1045756326-project May 11 07:41:03.952321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:41:03.952321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:41:03.952321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: 2a3cf6ced4ed4d4e87cb9934f020b055 May 11 07:41:03.952321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-VolumesActionsTest-1045756326-project May 11 07:41:03.952321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:41:03.952321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance 40c3ef2c-456d-44de-805e-9011046e7b1a could not be found. May 11 07:41:03.952321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '40c3ef2c-456d-44de-805e-9011046e7b1a'} May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40c3ef2c-456d-44de-805e-9011046e7b1a could not be found. May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:41:03.953205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c3ef2c-456d-44de-805e-9011046e7b1a could not be found. May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c3ef2c-456d-44de-805e-9011046e7b1a could not be found. May 11 07:41:03.954564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:41:03.955708 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b17934fd-12a0-4ade-b4a0-c58257e32521 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] Returning 404 to user: Instance 40c3ef2c-456d-44de-805e-9011046e7b1a could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:41:03.955708 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-b17934fd-12a0-4ade-b4a0-c58257e32521 tempest-VolumesActionsTest-1045756326 tempest-VolumesActionsTest-1045756326-project] 10.222.0.36 "GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a" status: 404 len: 111 microversion: 2.1 time: 0.031474 May 11 07:41:03.955708 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 171/336] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:03 2022] GET /compute/v2.1/servers/40c3ef2c-456d-44de-805e-9011046e7b1a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 07:41:04.005399 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-1f6273a4-180d-41e8-a776-19f501bd6f5f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:04.013893 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-1f6273a4-180d-41e8-a776-19f501bd6f5f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.155150 May 11 07:41:04.014452 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 166/337] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:03 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:04.468168 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-87390aed-9326-4c37-b76d-9f6f8378b9ee tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:04.468861 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-87390aed-9326-4c37-b76d-9f6f8378b9ee tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:04.476217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-87390aed-9326-4c37-b76d-9f6f8378b9ee tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:04.476728 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-87390aed-9326-4c37-b76d-9f6f8378b9ee tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:04.477579 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-87390aed-9326-4c37-b76d-9f6f8378b9ee tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:04.478021 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-87390aed-9326-4c37-b76d-9f6f8378b9ee tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:04.608926 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-87390aed-9326-4c37-b76d-9f6f8378b9ee tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:04.617130 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-87390aed-9326-4c37-b76d-9f6f8378b9ee tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:04.618733 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-87390aed-9326-4c37-b76d-9f6f8378b9ee tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:04.620591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-87390aed-9326-4c37-b76d-9f6f8378b9ee tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1720 microversion: 2.20 time: 0.156341 May 11 07:41:04.621209 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 172/338] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:04 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:04.647288 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-58d06c33-1995-4d43-9722-c6adb7cb0aa7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:04.647906 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-58d06c33-1995-4d43-9722-c6adb7cb0aa7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:04.653828 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-58d06c33-1995-4d43-9722-c6adb7cb0aa7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:04.654280 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-58d06c33-1995-4d43-9722-c6adb7cb0aa7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:04.655048 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-58d06c33-1995-4d43-9722-c6adb7cb0aa7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:04.655482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-58d06c33-1995-4d43-9722-c6adb7cb0aa7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:04.795255 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-58d06c33-1995-4d43-9722-c6adb7cb0aa7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:04.802536 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-58d06c33-1995-4d43-9722-c6adb7cb0aa7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.159101 May 11 07:41:04.803090 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 167/339] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:04 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:05.031415 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-467a0ef8-2e12-4b1c-8c8c-4b427ecd8c96 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:05.032023 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-467a0ef8-2e12-4b1c-8c8c-4b427ecd8c96 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:05.037868 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-467a0ef8-2e12-4b1c-8c8c-4b427ecd8c96 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:05.038321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-467a0ef8-2e12-4b1c-8c8c-4b427ecd8c96 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:05.039092 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-467a0ef8-2e12-4b1c-8c8c-4b427ecd8c96 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:05.039537 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-467a0ef8-2e12-4b1c-8c8c-4b427ecd8c96 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:05.168995 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-467a0ef8-2e12-4b1c-8c8c-4b427ecd8c96 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:05.176765 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-467a0ef8-2e12-4b1c-8c8c-4b427ecd8c96 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.149193 May 11 07:41:05.177317 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 173/340] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:05 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:05.639831 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9f888c79-2315-44b9-ad20-8f85274e616d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:05.640443 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9f888c79-2315-44b9-ad20-8f85274e616d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:05.647291 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9f888c79-2315-44b9-ad20-8f85274e616d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:05.647750 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9f888c79-2315-44b9-ad20-8f85274e616d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:05.648515 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9f888c79-2315-44b9-ad20-8f85274e616d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:05.648961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9f888c79-2315-44b9-ad20-8f85274e616d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:05.772668 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9f888c79-2315-44b9-ad20-8f85274e616d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:05.780309 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9f888c79-2315-44b9-ad20-8f85274e616d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:05.781836 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9f888c79-2315-44b9-ad20-8f85274e616d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:05.782975 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9f888c79-2315-44b9-ad20-8f85274e616d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1720 microversion: 2.20 time: 0.147699 May 11 07:41:05.783569 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 168/341] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:05 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:05.819131 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c928a426-d2f8-4961-890a-920d413ffb23 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:05.819729 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-c928a426-d2f8-4961-890a-920d413ffb23 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:05.826598 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c928a426-d2f8-4961-890a-920d413ffb23 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:05.827040 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c928a426-d2f8-4961-890a-920d413ffb23 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:05.827788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c928a426-d2f8-4961-890a-920d413ffb23 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:05.828214 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c928a426-d2f8-4961-890a-920d413ffb23 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:05.957884 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-c928a426-d2f8-4961-890a-920d413ffb23 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:05.965107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c928a426-d2f8-4961-890a-920d413ffb23 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.149963 May 11 07:41:05.965687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 174/342] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:05 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:06.193902 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-19733baf-b987-49af-ac67-f8b803a5e9f1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:06.194504 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-19733baf-b987-49af-ac67-f8b803a5e9f1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:06.200569 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-19733baf-b987-49af-ac67-f8b803a5e9f1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:06.201017 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-19733baf-b987-49af-ac67-f8b803a5e9f1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:06.201845 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-19733baf-b987-49af-ac67-f8b803a5e9f1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:06.202304 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-19733baf-b987-49af-ac67-f8b803a5e9f1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:06.323477 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-19733baf-b987-49af-ac67-f8b803a5e9f1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:06.331035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-19733baf-b987-49af-ac67-f8b803a5e9f1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.141201 May 11 07:41:06.331584 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 169/343] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:06 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:06.694455 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-57a4950b-93ac-4c4c-8eca-11916d8cab24 req-822d6208-5f73-4764-bfbd-2cb6afc5abd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe41f4-cc5e-4cc7-bc04-ebff35bfd769", "name": "network-vif-unplugged", "status": "completed", "tag": "1e8c8dbc-18a9-44e8-8ac6-273b984ed899"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:41:06.703353 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-57a4950b-93ac-4c4c-8eca-11916d8cab24 req-822d6208-5f73-4764-bfbd-2cb6afc5abd4 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:06.703887 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-57a4950b-93ac-4c4c-8eca-11916d8cab24 req-822d6208-5f73-4764-bfbd-2cb6afc5abd4 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:06.721623 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-57a4950b-93ac-4c4c-8eca-11916d8cab24 req-822d6208-5f73-4764-bfbd-2cb6afc5abd4 service nova] Creating event network-vif-unplugged:1e8c8dbc-18a9-44e8-8ac6-273b984ed899 for instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 on hv-cinder-83699 May 11 07:41:06.726447 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-57a4950b-93ac-4c4c-8eca-11916d8cab24 req-822d6208-5f73-4764-bfbd-2cb6afc5abd4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035831 May 11 07:41:06.727042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 175/344] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:41:06.800882 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b6e87d8c-494c-424a-bd62-fac3c3a43abf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:06.801487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-b6e87d8c-494c-424a-bd62-fac3c3a43abf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:06.807752 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b6e87d8c-494c-424a-bd62-fac3c3a43abf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:06.808203 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b6e87d8c-494c-424a-bd62-fac3c3a43abf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:06.808971 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b6e87d8c-494c-424a-bd62-fac3c3a43abf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:06.809409 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b6e87d8c-494c-424a-bd62-fac3c3a43abf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:06.935917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-b6e87d8c-494c-424a-bd62-fac3c3a43abf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:06.943823 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-b6e87d8c-494c-424a-bd62-fac3c3a43abf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:06.945318 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-b6e87d8c-494c-424a-bd62-fac3c3a43abf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:06.946491 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-b6e87d8c-494c-424a-bd62-fac3c3a43abf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1720 microversion: 2.20 time: 0.149485 May 11 07:41:06.947046 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 170/345] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:06 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:06.981959 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6f1dd402-5544-4a61-b96c-74b939feb7cd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:06.982649 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-6f1dd402-5544-4a61-b96c-74b939feb7cd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:06.988705 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6f1dd402-5544-4a61-b96c-74b939feb7cd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:06.989151 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6f1dd402-5544-4a61-b96c-74b939feb7cd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:06.989940 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6f1dd402-5544-4a61-b96c-74b939feb7cd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:06.990374 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6f1dd402-5544-4a61-b96c-74b939feb7cd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:07.121097 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-6f1dd402-5544-4a61-b96c-74b939feb7cd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:07.128661 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-6f1dd402-5544-4a61-b96c-74b939feb7cd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.151350 May 11 07:41:07.129219 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 176/346] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:06 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:07.347817 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7993b7af-f82c-4feb-9b8e-26f66d417f2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:07.348350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7993b7af-f82c-4feb-9b8e-26f66d417f2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:07.354298 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7993b7af-f82c-4feb-9b8e-26f66d417f2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:07.354748 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7993b7af-f82c-4feb-9b8e-26f66d417f2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:07.355505 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7993b7af-f82c-4feb-9b8e-26f66d417f2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:07.355939 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7993b7af-f82c-4feb-9b8e-26f66d417f2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:07.481170 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7993b7af-f82c-4feb-9b8e-26f66d417f2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:07.489010 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7993b7af-f82c-4feb-9b8e-26f66d417f2b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.145024 May 11 07:41:07.489574 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 171/347] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:07 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:07.965133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ab86475f-99ee-4036-bd0c-4613f0006a84 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:07.965696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ab86475f-99ee-4036-bd0c-4613f0006a84 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:07.971373 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ab86475f-99ee-4036-bd0c-4613f0006a84 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:07.971814 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ab86475f-99ee-4036-bd0c-4613f0006a84 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:07.972565 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ab86475f-99ee-4036-bd0c-4613f0006a84 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:07.972997 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ab86475f-99ee-4036-bd0c-4613f0006a84 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:08.098914 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ab86475f-99ee-4036-bd0c-4613f0006a84 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:08.107146 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ab86475f-99ee-4036-bd0c-4613f0006a84 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:08.108659 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ab86475f-99ee-4036-bd0c-4613f0006a84 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:08.109814 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ab86475f-99ee-4036-bd0c-4613f0006a84 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1720 microversion: 2.20 time: 0.149084 May 11 07:41:08.110362 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 177/348] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:07 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 07:41:08.146036 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f5601c6f-3f81-482a-93dd-de881fcf7104 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:08.146638 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f5601c6f-3f81-482a-93dd-de881fcf7104 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:08.154023 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f5601c6f-3f81-482a-93dd-de881fcf7104 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:08.154538 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f5601c6f-3f81-482a-93dd-de881fcf7104 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:08.155399 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f5601c6f-3f81-482a-93dd-de881fcf7104 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:08.155876 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f5601c6f-3f81-482a-93dd-de881fcf7104 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:08.280677 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f5601c6f-3f81-482a-93dd-de881fcf7104 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:08.287904 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f5601c6f-3f81-482a-93dd-de881fcf7104 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.145607 May 11 07:41:08.288467 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 172/349] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:08 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:08.506486 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c698f754-0e8a-44f5-875c-eef723c15f0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:08.507084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-c698f754-0e8a-44f5-875c-eef723c15f0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:08.513415 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c698f754-0e8a-44f5-875c-eef723c15f0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:08.513921 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c698f754-0e8a-44f5-875c-eef723c15f0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:08.514674 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c698f754-0e8a-44f5-875c-eef723c15f0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:08.515104 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c698f754-0e8a-44f5-875c-eef723c15f0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:08.896641 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-c698f754-0e8a-44f5-875c-eef723c15f0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:08.904581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c698f754-0e8a-44f5-875c-eef723c15f0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.401911 May 11 07:41:08.905152 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 178/350] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:08 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:09.129482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-63ef3339-a9d7-4a54-8bb9-69aae50286ce tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:09.130742 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-63ef3339-a9d7-4a54-8bb9-69aae50286ce tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:09.138758 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-63ef3339-a9d7-4a54-8bb9-69aae50286ce tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:09.139668 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-63ef3339-a9d7-4a54-8bb9-69aae50286ce tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:09.140724 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-63ef3339-a9d7-4a54-8bb9-69aae50286ce tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:09.141316 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-63ef3339-a9d7-4a54-8bb9-69aae50286ce tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:09.299977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-63ef3339-a9d7-4a54-8bb9-69aae50286ce tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:09.309705 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-63ef3339-a9d7-4a54-8bb9-69aae50286ce tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:09.311081 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ac3e167e-a84b-4d5d-8a84-f9920e5c05c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:09.312037 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ac3e167e-a84b-4d5d-8a84-f9920e5c05c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:09.312280 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-63ef3339-a9d7-4a54-8bb9-69aae50286ce tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:09.313761 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-63ef3339-a9d7-4a54-8bb9-69aae50286ce tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1663 microversion: 2.20 time: 0.189017 May 11 07:41:09.320700 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ac3e167e-a84b-4d5d-8a84-f9920e5c05c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:09.321474 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ac3e167e-a84b-4d5d-8a84-f9920e5c05c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:09.323202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ac3e167e-a84b-4d5d-8a84-f9920e5c05c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:09.324053 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ac3e167e-a84b-4d5d-8a84-f9920e5c05c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:09.327556 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 173/351] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:09 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1663 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:09.332610 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-bd37ce14-0654-4f8b-b427-0f50c31c92e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c06adbd-0e43-4f61-835a-10186b99587e"}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:41:09.334016 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-bd37ce14-0654-4f8b-b427-0f50c31c92e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:09.341873 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bd37ce14-0654-4f8b-b427-0f50c31c92e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:09.342527 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bd37ce14-0654-4f8b-b427-0f50c31c92e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:09.343612 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bd37ce14-0654-4f8b-b427-0f50c31c92e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:09.344061 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bd37ce14-0654-4f8b-b427-0f50c31c92e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:09.541984 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ac3e167e-a84b-4d5d-8a84-f9920e5c05c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:09.550604 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ac3e167e-a84b-4d5d-8a84-f9920e5c05c2 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.249017 May 11 07:41:09.560237 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 179/352] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:09 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:41:09.687243 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-bd37ce14-0654-4f8b-b427-0f50c31c92e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "POST /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.358080 May 11 07:41:09.687844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 174/353] 10.222.0.36 () {62 vars in 1363 bytes} [Wed May 11 07:41:09 2022] POST /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/os-volume_attachments => generated 188 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:41:09.832530 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-db6b6aef-4885-4b1f-9327-758e00133e0d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:41:09.833289 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-db6b6aef-4885-4b1f-9327-758e00133e0d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:09.840335 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-db6b6aef-4885-4b1f-9327-758e00133e0d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:09.840786 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-db6b6aef-4885-4b1f-9327-758e00133e0d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:09.841567 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-db6b6aef-4885-4b1f-9327-758e00133e0d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:09.842004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-db6b6aef-4885-4b1f-9327-758e00133e0d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:09.923141 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a2476f0f-f742-4611-9109-d47db4cf83c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:09.923902 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a2476f0f-f742-4611-9109-d47db4cf83c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:09.942965 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a2476f0f-f742-4611-9109-d47db4cf83c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:09.943618 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a2476f0f-f742-4611-9109-d47db4cf83c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:09.944483 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a2476f0f-f742-4611-9109-d47db4cf83c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:09.945033 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a2476f0f-f742-4611-9109-d47db4cf83c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:09.948309 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-db6b6aef-4885-4b1f-9327-758e00133e0d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "POST /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/action" status: 202 len: 0 microversion: 2.20 time: 0.121152 May 11 07:41:09.952614 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 180/354] 10.222.0.36 () {62 vars in 1318 bytes} [Wed May 11 07:41:09 2022] POST /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 07:41:09.958552 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-fd131fd4-5ae8-4bf2-ab5c-eddc29cf70b2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:09.959258 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-fd131fd4-5ae8-4bf2-ab5c-eddc29cf70b2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:09.966544 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd131fd4-5ae8-4bf2-ab5c-eddc29cf70b2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:09.967002 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd131fd4-5ae8-4bf2-ab5c-eddc29cf70b2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:09.967796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd131fd4-5ae8-4bf2-ab5c-eddc29cf70b2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:09.968235 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd131fd4-5ae8-4bf2-ab5c-eddc29cf70b2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:10.163787 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-fd131fd4-5ae8-4bf2-ab5c-eddc29cf70b2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:10.180420 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-fd131fd4-5ae8-4bf2-ab5c-eddc29cf70b2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:10.187124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-fd131fd4-5ae8-4bf2-ab5c-eddc29cf70b2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:10.188703 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a2476f0f-f742-4611-9109-d47db4cf83c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:10.189934 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-fd131fd4-5ae8-4bf2-ab5c-eddc29cf70b2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1749 microversion: 2.20 time: 0.235673 May 11 07:41:10.199264 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a2476f0f-f742-4611-9109-d47db4cf83c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.280315 May 11 07:41:10.199833 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 175/355] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:09 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:41:10.201850 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 181/356] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:09 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1749 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:10.568297 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-6aca2ac7-4709-4b0a-87ff-b7768ce9695a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:10.569061 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-6aca2ac7-4709-4b0a-87ff-b7768ce9695a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:10.578097 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6aca2ac7-4709-4b0a-87ff-b7768ce9695a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:10.578558 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6aca2ac7-4709-4b0a-87ff-b7768ce9695a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:10.582910 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6aca2ac7-4709-4b0a-87ff-b7768ce9695a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:10.583569 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6aca2ac7-4709-4b0a-87ff-b7768ce9695a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:10.801203 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-6aca2ac7-4709-4b0a-87ff-b7768ce9695a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:10.809238 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-6aca2ac7-4709-4b0a-87ff-b7768ce9695a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.245077 May 11 07:41:10.819797 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 176/357] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:10 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:11.208396 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-9bf59de9-b9c0-40bd-b2d8-93348bad7d65 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:11.209841 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-9bf59de9-b9c0-40bd-b2d8-93348bad7d65 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:11.216264 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4f4f7a95-4a5a-4b4d-be37-dbbf56e020b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:11.217177 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4f4f7a95-4a5a-4b4d-be37-dbbf56e020b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:11.229316 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4f4f7a95-4a5a-4b4d-be37-dbbf56e020b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:11.231730 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4f4f7a95-4a5a-4b4d-be37-dbbf56e020b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:11.232249 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9bf59de9-b9c0-40bd-b2d8-93348bad7d65 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:11.232940 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9bf59de9-b9c0-40bd-b2d8-93348bad7d65 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:11.233318 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4f4f7a95-4a5a-4b4d-be37-dbbf56e020b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:11.233797 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4f4f7a95-4a5a-4b4d-be37-dbbf56e020b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:11.234305 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9bf59de9-b9c0-40bd-b2d8-93348bad7d65 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:11.234894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9bf59de9-b9c0-40bd-b2d8-93348bad7d65 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:11.530810 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4f4f7a95-4a5a-4b4d-be37-dbbf56e020b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:11.532602 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-9bf59de9-b9c0-40bd-b2d8-93348bad7d65 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:11.544267 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4f4f7a95-4a5a-4b4d-be37-dbbf56e020b1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1721 microversion: 2.1 time: 0.332005 May 11 07:41:11.545176 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-9bf59de9-b9c0-40bd-b2d8-93348bad7d65 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:11.546970 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-9bf59de9-b9c0-40bd-b2d8-93348bad7d65 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:11.548399 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-9bf59de9-b9c0-40bd-b2d8-93348bad7d65 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1749 microversion: 2.20 time: 0.343764 May 11 07:41:11.549165 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 182/358] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:11 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1749 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:11.559138 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 177/359] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:11 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1721 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:41:11.837256 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1f28542c-8dd7-45f6-a48d-7dceb670d5b0 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:11.839393 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-1f28542c-8dd7-45f6-a48d-7dceb670d5b0 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:11.859398 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1f28542c-8dd7-45f6-a48d-7dceb670d5b0 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:11.863783 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1f28542c-8dd7-45f6-a48d-7dceb670d5b0 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:11.865018 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1f28542c-8dd7-45f6-a48d-7dceb670d5b0 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:11.865853 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1f28542c-8dd7-45f6-a48d-7dceb670d5b0 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:12.056936 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-1f28542c-8dd7-45f6-a48d-7dceb670d5b0 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:12.068779 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-1f28542c-8dd7-45f6-a48d-7dceb670d5b0 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.246208 May 11 07:41:12.079262 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 178/360] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:11 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:12.576936 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-6d62f96b-bbfe-411f-8ca1-b353453d506a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:12.578062 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-162c98cb-a1b7-469b-9bb4-5fd6aeaf2bda tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:12.579561 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-6d62f96b-bbfe-411f-8ca1-b353453d506a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:12.580564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-162c98cb-a1b7-469b-9bb4-5fd6aeaf2bda tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:12.596676 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6d62f96b-bbfe-411f-8ca1-b353453d506a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:12.599603 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6d62f96b-bbfe-411f-8ca1-b353453d506a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:12.600495 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-162c98cb-a1b7-469b-9bb4-5fd6aeaf2bda tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:12.601872 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-162c98cb-a1b7-469b-9bb4-5fd6aeaf2bda tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:12.602620 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6d62f96b-bbfe-411f-8ca1-b353453d506a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:12.604835 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-162c98cb-a1b7-469b-9bb4-5fd6aeaf2bda tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:12.606295 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6d62f96b-bbfe-411f-8ca1-b353453d506a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:12.607639 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-162c98cb-a1b7-469b-9bb4-5fd6aeaf2bda tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:12.882447 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-6d62f96b-bbfe-411f-8ca1-b353453d506a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:12.891999 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-6d62f96b-bbfe-411f-8ca1-b353453d506a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:12.901126 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-6d62f96b-bbfe-411f-8ca1-b353453d506a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:12.903968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-6d62f96b-bbfe-411f-8ca1-b353453d506a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.336501 May 11 07:41:12.904720 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 179/361] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:12 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 07:41:12.916777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-05f7ac49-0c68-4735-8dab-74ab88ee097d req-c4e3def1-0a2c-43ac-9d5f-2490c0aee13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0", "name": "network-vif-plugged", "status": "completed", "tag": "984a3ee7-17e5-4143-9062-ba7a44b7d5ad"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:41:12.933219 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-05f7ac49-0c68-4735-8dab-74ab88ee097d req-c4e3def1-0a2c-43ac-9d5f-2490c0aee13d service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:12.933900 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-05f7ac49-0c68-4735-8dab-74ab88ee097d req-c4e3def1-0a2c-43ac-9d5f-2490c0aee13d service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:12.952227 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-05f7ac49-0c68-4735-8dab-74ab88ee097d req-c4e3def1-0a2c-43ac-9d5f-2490c0aee13d service nova] Creating event network-vif-plugged:984a3ee7-17e5-4143-9062-ba7a44b7d5ad for instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 on hv-cinder-83699 May 11 07:41:12.959767 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-05f7ac49-0c68-4735-8dab-74ab88ee097d req-c4e3def1-0a2c-43ac-9d5f-2490c0aee13d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053682 May 11 07:41:12.961047 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 180/362] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:41:13.001130 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-162c98cb-a1b7-469b-9bb4-5fd6aeaf2bda tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:13.009144 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-162c98cb-a1b7-469b-9bb4-5fd6aeaf2bda tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1698 microversion: 2.1 time: 0.446234 May 11 07:41:13.011293 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 183/363] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:12 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1698 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:13.028007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-6d07617c-c319-4db1-af14-07f35d546708 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:41:13.036684 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6d07617c-c319-4db1-af14-07f35d546708 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:13.037397 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6d07617c-c319-4db1-af14-07f35d546708 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:13.063419 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-6d07617c-c319-4db1-af14-07f35d546708 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Going to try to start instance {{(pid=123600) start /opt/stack/nova/nova/compute/api.py:2730}} May 11 07:41:13.089316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ddf1ad19-f77b-47da-b3b1-4b3fe3227440 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:13.090576 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ddf1ad19-f77b-47da-b3b1-4b3fe3227440 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:13.115444 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ddf1ad19-f77b-47da-b3b1-4b3fe3227440 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:13.116749 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ddf1ad19-f77b-47da-b3b1-4b3fe3227440 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:13.117916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-6d07617c-c319-4db1-af14-07f35d546708 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "POST /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/action" status: 202 len: 0 microversion: 2.1 time: 0.094086 May 11 07:41:13.118069 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ddf1ad19-f77b-47da-b3b1-4b3fe3227440 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:13.121580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 181/364] 10.222.0.36 () {60 vars in 1277 bytes} [Wed May 11 07:41:13 2022] POST /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:41:13.130136 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b5deffed-fc89-46b8-918e-ec4265a4eebd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:13.130334 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ddf1ad19-f77b-47da-b3b1-4b3fe3227440 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:13.130834 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-b5deffed-fc89-46b8-918e-ec4265a4eebd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:13.143742 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b5deffed-fc89-46b8-918e-ec4265a4eebd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:13.145903 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b5deffed-fc89-46b8-918e-ec4265a4eebd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:13.145903 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b5deffed-fc89-46b8-918e-ec4265a4eebd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:13.146445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b5deffed-fc89-46b8-918e-ec4265a4eebd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:13.581022 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-b5deffed-fc89-46b8-918e-ec4265a4eebd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:13.581403 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ddf1ad19-f77b-47da-b3b1-4b3fe3227440 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:13.590949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ddf1ad19-f77b-47da-b3b1-4b3fe3227440 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.507776 May 11 07:41:13.591741 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 184/365] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:13 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:13.597632 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-b5deffed-fc89-46b8-918e-ec4265a4eebd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1707 microversion: 2.1 time: 0.469319 May 11 07:41:13.602416 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 182/366] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:13 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1707 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:13.925805 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a1c74814-d49f-4e6c-9997-0571f948da08 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:13.926707 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a1c74814-d49f-4e6c-9997-0571f948da08 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:13.945786 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a1c74814-d49f-4e6c-9997-0571f948da08 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:13.946444 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a1c74814-d49f-4e6c-9997-0571f948da08 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:13.947573 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a1c74814-d49f-4e6c-9997-0571f948da08 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:13.948181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a1c74814-d49f-4e6c-9997-0571f948da08 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:14.126384 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a1c74814-d49f-4e6c-9997-0571f948da08 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:14.137476 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a1c74814-d49f-4e6c-9997-0571f948da08 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:14.139634 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a1c74814-d49f-4e6c-9997-0571f948da08 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:14.141340 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a1c74814-d49f-4e6c-9997-0571f948da08 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.221080 May 11 07:41:14.141926 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 185/367] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:13 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:14.609511 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7eb442a9-41b9-4697-acab-e6d641b4e1ec tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:14.610937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7eb442a9-41b9-4697-acab-e6d641b4e1ec tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:14.612169 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0bc2aee6-5b97-4896-bf52-5506d6a12673 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:14.613035 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0bc2aee6-5b97-4896-bf52-5506d6a12673 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:14.624940 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7eb442a9-41b9-4697-acab-e6d641b4e1ec tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:14.625899 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7eb442a9-41b9-4697-acab-e6d641b4e1ec tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:14.626912 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7eb442a9-41b9-4697-acab-e6d641b4e1ec tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:14.627524 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7eb442a9-41b9-4697-acab-e6d641b4e1ec tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:14.628564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0bc2aee6-5b97-4896-bf52-5506d6a12673 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:14.630281 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0bc2aee6-5b97-4896-bf52-5506d6a12673 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:14.637207 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0bc2aee6-5b97-4896-bf52-5506d6a12673 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:14.639218 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0bc2aee6-5b97-4896-bf52-5506d6a12673 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:14.863243 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7eb442a9-41b9-4697-acab-e6d641b4e1ec tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:14.882691 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0bc2aee6-5b97-4896-bf52-5506d6a12673 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:14.889730 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7eb442a9-41b9-4697-acab-e6d641b4e1ec tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1264 microversion: 2.1 time: 0.284710 May 11 07:41:14.890317 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 183/368] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:14 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1264 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:14.896917 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0bc2aee6-5b97-4896-bf52-5506d6a12673 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1707 microversion: 2.1 time: 0.289211 May 11 07:41:14.896917 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 186/369] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:14 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1707 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:41:15.160666 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-59f5ca4f-6e4b-4eec-9d12-8347e2efe5dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:15.161327 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-59f5ca4f-6e4b-4eec-9d12-8347e2efe5dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:15.168418 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-59f5ca4f-6e4b-4eec-9d12-8347e2efe5dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:15.168930 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-59f5ca4f-6e4b-4eec-9d12-8347e2efe5dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:15.169878 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-59f5ca4f-6e4b-4eec-9d12-8347e2efe5dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:15.170335 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-59f5ca4f-6e4b-4eec-9d12-8347e2efe5dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:15.312631 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-59f5ca4f-6e4b-4eec-9d12-8347e2efe5dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:15.321896 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-59f5ca4f-6e4b-4eec-9d12-8347e2efe5dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:15.323399 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-59f5ca4f-6e4b-4eec-9d12-8347e2efe5dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:15.324583 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-59f5ca4f-6e4b-4eec-9d12-8347e2efe5dd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.168356 May 11 07:41:15.334910 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 184/370] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:15 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:15.907218 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-cbfb198c-3922-4eff-a9b9-0f70b3ac2947 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:15.914046 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a9e84d41-d842-470e-8f8f-cf8eb3f85ba5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:15.915422 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a9e84d41-d842-470e-8f8f-cf8eb3f85ba5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:15.919347 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-cbfb198c-3922-4eff-a9b9-0f70b3ac2947 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:15.943163 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a9e84d41-d842-470e-8f8f-cf8eb3f85ba5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:15.943636 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a9e84d41-d842-470e-8f8f-cf8eb3f85ba5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:15.944447 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a9e84d41-d842-470e-8f8f-cf8eb3f85ba5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:15.944825 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a9e84d41-d842-470e-8f8f-cf8eb3f85ba5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:15.947087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cbfb198c-3922-4eff-a9b9-0f70b3ac2947 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:15.947565 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cbfb198c-3922-4eff-a9b9-0f70b3ac2947 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:15.951298 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cbfb198c-3922-4eff-a9b9-0f70b3ac2947 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:15.951793 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cbfb198c-3922-4eff-a9b9-0f70b3ac2947 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:16.192358 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-cbfb198c-3922-4eff-a9b9-0f70b3ac2947 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:16.206121 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-cbfb198c-3922-4eff-a9b9-0f70b3ac2947 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1451 microversion: 2.1 time: 0.298922 May 11 07:41:16.207014 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 187/371] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:15 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1451 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:16.218652 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a9e84d41-d842-470e-8f8f-cf8eb3f85ba5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:16.224096 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a9e84d41-d842-470e-8f8f-cf8eb3f85ba5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1711 microversion: 2.1 time: 0.312133 May 11 07:41:16.233229 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2136be38-9a72-40d0-964e-503dae50e61a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:16.236031 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2136be38-9a72-40d0-964e-503dae50e61a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:16.237319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 185/372] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:15 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1711 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:16.246063 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2136be38-9a72-40d0-964e-503dae50e61a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:16.246533 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2136be38-9a72-40d0-964e-503dae50e61a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:16.247339 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2136be38-9a72-40d0-964e-503dae50e61a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:16.252051 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2136be38-9a72-40d0-964e-503dae50e61a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:16.343830 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4525686f-22e8-4a2f-9e56-9c2e0bbe00dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:16.344436 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4525686f-22e8-4a2f-9e56-9c2e0bbe00dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:16.356285 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4525686f-22e8-4a2f-9e56-9c2e0bbe00dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:16.357095 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4525686f-22e8-4a2f-9e56-9c2e0bbe00dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:16.358200 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4525686f-22e8-4a2f-9e56-9c2e0bbe00dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:16.359028 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4525686f-22e8-4a2f-9e56-9c2e0bbe00dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:16.470301 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2136be38-9a72-40d0-964e-503dae50e61a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:16.488578 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2136be38-9a72-40d0-964e-503dae50e61a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1451 microversion: 2.1 time: 0.263994 May 11 07:41:16.489781 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 188/373] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:16 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1451 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:16.596303 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4525686f-22e8-4a2f-9e56-9c2e0bbe00dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:16.613379 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4525686f-22e8-4a2f-9e56-9c2e0bbe00dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:16.615981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4525686f-22e8-4a2f-9e56-9c2e0bbe00dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:16.617747 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4525686f-22e8-4a2f-9e56-9c2e0bbe00dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.278674 May 11 07:41:16.632487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 186/374] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:16 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:17.637412 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-037cfe3c-1408-473c-b7df-6052dfc7ca92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:17.638223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-037cfe3c-1408-473c-b7df-6052dfc7ca92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:17.654899 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-037cfe3c-1408-473c-b7df-6052dfc7ca92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:17.655422 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-037cfe3c-1408-473c-b7df-6052dfc7ca92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:17.656313 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-037cfe3c-1408-473c-b7df-6052dfc7ca92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:17.656853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-037cfe3c-1408-473c-b7df-6052dfc7ca92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:17.838857 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-037cfe3c-1408-473c-b7df-6052dfc7ca92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:17.848522 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-037cfe3c-1408-473c-b7df-6052dfc7ca92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:17.852081 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-037cfe3c-1408-473c-b7df-6052dfc7ca92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:17.855323 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-037cfe3c-1408-473c-b7df-6052dfc7ca92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.222297 May 11 07:41:17.867171 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 189/375] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:17 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:18.876990 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f5a5b92b-577f-44f0-8d0a-0911561cb637 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:18.878679 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f5a5b92b-577f-44f0-8d0a-0911561cb637 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:18.896178 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f5a5b92b-577f-44f0-8d0a-0911561cb637 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:18.902430 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f5a5b92b-577f-44f0-8d0a-0911561cb637 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:18.904080 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f5a5b92b-577f-44f0-8d0a-0911561cb637 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:18.904990 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f5a5b92b-577f-44f0-8d0a-0911561cb637 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:19.175621 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f5a5b92b-577f-44f0-8d0a-0911561cb637 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:19.188055 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f5a5b92b-577f-44f0-8d0a-0911561cb637 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:19.189590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f5a5b92b-577f-44f0-8d0a-0911561cb637 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:19.190519 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f5a5b92b-577f-44f0-8d0a-0911561cb637 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.319273 May 11 07:41:19.191632 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 187/376] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:18 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:19.722465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-5db4ad30-40dc-4cc5-822c-7a2e8c588dcc req-25ab831a-ab1a-4126-bd2a-5272d312e1fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0", "tag": "984a3ee7-17e5-4143-9062-ba7a44b7d5ad"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:41:19.735962 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-5db4ad30-40dc-4cc5-822c-7a2e8c588dcc req-25ab831a-ab1a-4126-bd2a-5272d312e1fb service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:19.736499 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-5db4ad30-40dc-4cc5-822c-7a2e8c588dcc req-25ab831a-ab1a-4126-bd2a-5272d312e1fb service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:19.757278 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-5db4ad30-40dc-4cc5-822c-7a2e8c588dcc req-25ab831a-ab1a-4126-bd2a-5272d312e1fb service nova] Creating event network-changed:984a3ee7-17e5-4143-9062-ba7a44b7d5ad for instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 on hv-cinder-83699 May 11 07:41:19.765708 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-5db4ad30-40dc-4cc5-822c-7a2e8c588dcc req-25ab831a-ab1a-4126-bd2a-5272d312e1fb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046428 May 11 07:41:19.770497 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 190/377] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:41:20.213802 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-00abc3e9-788e-4915-8d11-19f670f5c73e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:20.214441 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-00abc3e9-788e-4915-8d11-19f670f5c73e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:20.230048 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00abc3e9-788e-4915-8d11-19f670f5c73e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:20.231261 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00abc3e9-788e-4915-8d11-19f670f5c73e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:20.233478 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00abc3e9-788e-4915-8d11-19f670f5c73e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:20.234788 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00abc3e9-788e-4915-8d11-19f670f5c73e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:20.523783 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-00abc3e9-788e-4915-8d11-19f670f5c73e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:20.533068 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-00abc3e9-788e-4915-8d11-19f670f5c73e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:20.534596 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-00abc3e9-788e-4915-8d11-19f670f5c73e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:20.535757 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-00abc3e9-788e-4915-8d11-19f670f5c73e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.327794 May 11 07:41:20.545371 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 188/378] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:20 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:21.561638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-110a9985-f381-4c3f-bf5f-6a9b792fd52c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:21.562464 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-110a9985-f381-4c3f-bf5f-6a9b792fd52c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:21.584067 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-110a9985-f381-4c3f-bf5f-6a9b792fd52c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:21.584519 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-110a9985-f381-4c3f-bf5f-6a9b792fd52c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:21.585474 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-110a9985-f381-4c3f-bf5f-6a9b792fd52c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:21.593971 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-110a9985-f381-4c3f-bf5f-6a9b792fd52c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:21.905052 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-110a9985-f381-4c3f-bf5f-6a9b792fd52c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:21.914672 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-110a9985-f381-4c3f-bf5f-6a9b792fd52c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:21.916429 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-110a9985-f381-4c3f-bf5f-6a9b792fd52c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:21.918018 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-110a9985-f381-4c3f-bf5f-6a9b792fd52c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.361328 May 11 07:41:21.919131 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 191/379] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:21 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:22.938104 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-85dba818-e2ae-43ef-a82f-b71ea9147730 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:22.944388 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-85dba818-e2ae-43ef-a82f-b71ea9147730 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:22.952583 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-85dba818-e2ae-43ef-a82f-b71ea9147730 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:22.953341 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-85dba818-e2ae-43ef-a82f-b71ea9147730 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:22.954421 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-85dba818-e2ae-43ef-a82f-b71ea9147730 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:22.955069 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-85dba818-e2ae-43ef-a82f-b71ea9147730 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:23.295475 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-85dba818-e2ae-43ef-a82f-b71ea9147730 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:23.310371 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-85dba818-e2ae-43ef-a82f-b71ea9147730 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:23.313388 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-85dba818-e2ae-43ef-a82f-b71ea9147730 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:23.314653 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-85dba818-e2ae-43ef-a82f-b71ea9147730 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.380544 May 11 07:41:23.317777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 189/380] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:22 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:24.338797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-941f58bd-fa37-4954-a87e-43eb225f55e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:24.339501 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-941f58bd-fa37-4954-a87e-43eb225f55e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:24.354445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-941f58bd-fa37-4954-a87e-43eb225f55e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:24.354998 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-941f58bd-fa37-4954-a87e-43eb225f55e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:24.355868 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-941f58bd-fa37-4954-a87e-43eb225f55e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:24.356374 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-941f58bd-fa37-4954-a87e-43eb225f55e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:24.556894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-941f58bd-fa37-4954-a87e-43eb225f55e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:24.567442 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-941f58bd-fa37-4954-a87e-43eb225f55e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:24.569496 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-941f58bd-fa37-4954-a87e-43eb225f55e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:24.573504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-941f58bd-fa37-4954-a87e-43eb225f55e1 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.235996 May 11 07:41:24.573504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 192/381] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:24 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:25.590734 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-0985e009-06e2-449c-a4c8-85973aff67f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:25.591988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-0985e009-06e2-449c-a4c8-85973aff67f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:25.599125 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0985e009-06e2-449c-a4c8-85973aff67f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:25.600053 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0985e009-06e2-449c-a4c8-85973aff67f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:25.601168 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0985e009-06e2-449c-a4c8-85973aff67f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:25.601655 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0985e009-06e2-449c-a4c8-85973aff67f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:25.734569 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0985e009-06e2-449c-a4c8-85973aff67f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:25.743225 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0985e009-06e2-449c-a4c8-85973aff67f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:25.745434 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0985e009-06e2-449c-a4c8-85973aff67f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:25.746681 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-0985e009-06e2-449c-a4c8-85973aff67f9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.160273 May 11 07:41:25.747444 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 190/382] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:25 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:26.765087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-97985fe3-180e-49a0-9811-1b782a8fe776 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:26.765808 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-97985fe3-180e-49a0-9811-1b782a8fe776 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:26.772668 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-97985fe3-180e-49a0-9811-1b782a8fe776 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:26.773071 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-97985fe3-180e-49a0-9811-1b782a8fe776 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:26.773876 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-97985fe3-180e-49a0-9811-1b782a8fe776 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:26.774315 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-97985fe3-180e-49a0-9811-1b782a8fe776 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:26.918919 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-97985fe3-180e-49a0-9811-1b782a8fe776 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:26.932815 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-97985fe3-180e-49a0-9811-1b782a8fe776 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:26.934367 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-97985fe3-180e-49a0-9811-1b782a8fe776 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:26.935678 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-97985fe3-180e-49a0-9811-1b782a8fe776 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.174775 May 11 07:41:26.936209 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 193/383] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:26 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:27.954122 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4508a5d1-55fd-414b-9ba0-4c4b64471e20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:27.954692 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4508a5d1-55fd-414b-9ba0-4c4b64471e20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:27.960892 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4508a5d1-55fd-414b-9ba0-4c4b64471e20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:27.961336 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4508a5d1-55fd-414b-9ba0-4c4b64471e20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:27.962131 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4508a5d1-55fd-414b-9ba0-4c4b64471e20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:27.963200 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4508a5d1-55fd-414b-9ba0-4c4b64471e20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:28.090471 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4508a5d1-55fd-414b-9ba0-4c4b64471e20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:28.098587 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4508a5d1-55fd-414b-9ba0-4c4b64471e20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:28.100072 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4508a5d1-55fd-414b-9ba0-4c4b64471e20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:28.101205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4508a5d1-55fd-414b-9ba0-4c4b64471e20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.151036 May 11 07:41:28.101785 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 191/384] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:27 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:29.118917 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3d9dc220-2ab6-4608-8f9e-846dca508b5a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:29.119599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-3d9dc220-2ab6-4608-8f9e-846dca508b5a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:29.126147 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3d9dc220-2ab6-4608-8f9e-846dca508b5a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:29.126676 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3d9dc220-2ab6-4608-8f9e-846dca508b5a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:29.127517 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3d9dc220-2ab6-4608-8f9e-846dca508b5a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:29.127962 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3d9dc220-2ab6-4608-8f9e-846dca508b5a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:29.255638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-3d9dc220-2ab6-4608-8f9e-846dca508b5a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:29.263772 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-3d9dc220-2ab6-4608-8f9e-846dca508b5a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:29.265251 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-3d9dc220-2ab6-4608-8f9e-846dca508b5a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:29.266415 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-3d9dc220-2ab6-4608-8f9e-846dca508b5a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.151970 May 11 07:41:29.266963 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 194/385] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:29 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:29.622229 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-167dd724-4ca4-41f8-8fcd-104dea905e6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00688635-2dc2-43bd-a4e7-b721c82865c6"}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:41:29.623366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-167dd724-4ca4-41f8-8fcd-104dea905e6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:29.629803 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-167dd724-4ca4-41f8-8fcd-104dea905e6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:29.630250 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-167dd724-4ca4-41f8-8fcd-104dea905e6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:29.631019 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-167dd724-4ca4-41f8-8fcd-104dea905e6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:29.631459 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-167dd724-4ca4-41f8-8fcd-104dea905e6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:29.890852 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-167dd724-4ca4-41f8-8fcd-104dea905e6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "POST /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272469 May 11 07:41:29.896373 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 192/386] 10.222.0.36 () {60 vars in 1322 bytes} [Wed May 11 07:41:29 2022] POST /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:41:30.285022 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-1aee8f04-af44-43d7-9408-e9a85ec16f66 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:30.285654 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-1aee8f04-af44-43d7-9408-e9a85ec16f66 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:30.292200 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1aee8f04-af44-43d7-9408-e9a85ec16f66 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:30.292630 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1aee8f04-af44-43d7-9408-e9a85ec16f66 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:30.293653 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1aee8f04-af44-43d7-9408-e9a85ec16f66 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:30.294045 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1aee8f04-af44-43d7-9408-e9a85ec16f66 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:30.423533 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-1aee8f04-af44-43d7-9408-e9a85ec16f66 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:30.432315 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-1aee8f04-af44-43d7-9408-e9a85ec16f66 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:30.433821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-1aee8f04-af44-43d7-9408-e9a85ec16f66 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:30.434998 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-1aee8f04-af44-43d7-9408-e9a85ec16f66 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.153940 May 11 07:41:30.435549 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 195/387] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:30 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:31.454356 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-cf90948d-d116-4ac3-987f-9907352a7895 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:31.455050 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-cf90948d-d116-4ac3-987f-9907352a7895 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:31.461662 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cf90948d-d116-4ac3-987f-9907352a7895 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:31.462119 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cf90948d-d116-4ac3-987f-9907352a7895 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:31.463514 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cf90948d-d116-4ac3-987f-9907352a7895 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:31.463952 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cf90948d-d116-4ac3-987f-9907352a7895 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:31.598969 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-cf90948d-d116-4ac3-987f-9907352a7895 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:31.607496 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-cf90948d-d116-4ac3-987f-9907352a7895 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:31.608981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-cf90948d-d116-4ac3-987f-9907352a7895 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:31.610156 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-cf90948d-d116-4ac3-987f-9907352a7895 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.159979 May 11 07:41:31.610701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 193/388] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:31 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:32.628076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-47ddf05e-aacd-4739-b16a-e070415ea445 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:32.628671 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-47ddf05e-aacd-4739-b16a-e070415ea445 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:32.635623 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-47ddf05e-aacd-4739-b16a-e070415ea445 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:32.636068 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-47ddf05e-aacd-4739-b16a-e070415ea445 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:32.636824 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-47ddf05e-aacd-4739-b16a-e070415ea445 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:32.637356 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-47ddf05e-aacd-4739-b16a-e070415ea445 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:32.768522 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-47ddf05e-aacd-4739-b16a-e070415ea445 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:32.776640 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-47ddf05e-aacd-4739-b16a-e070415ea445 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:32.778196 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-47ddf05e-aacd-4739-b16a-e070415ea445 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:32.779349 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-47ddf05e-aacd-4739-b16a-e070415ea445 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.155048 May 11 07:41:32.779908 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 196/389] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:32 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:33.797789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a1a03863-f22d-44ca-ac1b-cecca3a10fd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:33.798318 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a1a03863-f22d-44ca-ac1b-cecca3a10fd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:33.804574 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a1a03863-f22d-44ca-ac1b-cecca3a10fd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:33.805025 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a1a03863-f22d-44ca-ac1b-cecca3a10fd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:33.805821 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a1a03863-f22d-44ca-ac1b-cecca3a10fd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:33.806892 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a1a03863-f22d-44ca-ac1b-cecca3a10fd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:33.935272 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a1a03863-f22d-44ca-ac1b-cecca3a10fd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:33.943940 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a1a03863-f22d-44ca-ac1b-cecca3a10fd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:33.945432 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a1a03863-f22d-44ca-ac1b-cecca3a10fd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:33.946606 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a1a03863-f22d-44ca-ac1b-cecca3a10fd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.152858 May 11 07:41:33.947157 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 194/390] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:33 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:34.964252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-908c0baf-ab73-41b0-bc41-917ccaef2f94 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:34.964856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-908c0baf-ab73-41b0-bc41-917ccaef2f94 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:34.970939 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-908c0baf-ab73-41b0-bc41-917ccaef2f94 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:34.971389 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-908c0baf-ab73-41b0-bc41-917ccaef2f94 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:34.972146 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-908c0baf-ab73-41b0-bc41-917ccaef2f94 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:34.972579 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-908c0baf-ab73-41b0-bc41-917ccaef2f94 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:35.100256 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-908c0baf-ab73-41b0-bc41-917ccaef2f94 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:35.108700 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-908c0baf-ab73-41b0-bc41-917ccaef2f94 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:35.110421 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-908c0baf-ab73-41b0-bc41-917ccaef2f94 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:35.111643 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-908c0baf-ab73-41b0-bc41-917ccaef2f94 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.151422 May 11 07:41:35.112287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 197/391] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:34 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:36.129358 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-0d7f2f00-d046-408e-90ff-368984d6c9b6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:36.129990 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-0d7f2f00-d046-408e-90ff-368984d6c9b6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:36.136881 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0d7f2f00-d046-408e-90ff-368984d6c9b6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:36.137332 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0d7f2f00-d046-408e-90ff-368984d6c9b6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:36.138135 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0d7f2f00-d046-408e-90ff-368984d6c9b6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:36.138570 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0d7f2f00-d046-408e-90ff-368984d6c9b6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:36.281687 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0d7f2f00-d046-408e-90ff-368984d6c9b6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:36.289752 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0d7f2f00-d046-408e-90ff-368984d6c9b6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:36.291272 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0d7f2f00-d046-408e-90ff-368984d6c9b6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:36.292409 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-0d7f2f00-d046-408e-90ff-368984d6c9b6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.167017 May 11 07:41:36.292952 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 195/392] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:36 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:37.310751 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-f2139bd6-3c6b-407b-8c95-21995d425853 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:37.312199 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-f2139bd6-3c6b-407b-8c95-21995d425853 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:37.320012 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f2139bd6-3c6b-407b-8c95-21995d425853 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:37.322487 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f2139bd6-3c6b-407b-8c95-21995d425853 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:37.324085 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f2139bd6-3c6b-407b-8c95-21995d425853 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:37.325085 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f2139bd6-3c6b-407b-8c95-21995d425853 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:37.384830 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2781abf1-2456-4af7-98c1-b88be9cb19e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:41:37.385934 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2781abf1-2456-4af7-98c1-b88be9cb19e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:37.392310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2781abf1-2456-4af7-98c1-b88be9cb19e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:37.392840 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2781abf1-2456-4af7-98c1-b88be9cb19e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:37.393721 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2781abf1-2456-4af7-98c1-b88be9cb19e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:37.394164 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2781abf1-2456-4af7-98c1-b88be9cb19e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:37.417413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.objects.instance [None req-2781abf1-2456-4af7-98c1-b88be9cb19e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lazy-loading 'flavor' on Instance uuid a0b775a5-13c2-4d45-8015-d7a37683cfb1 {{(pid=123600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:41:37.466401 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-f2139bd6-3c6b-407b-8c95-21995d425853 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:37.474678 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-f2139bd6-3c6b-407b-8c95-21995d425853 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:37.476180 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-f2139bd6-3c6b-407b-8c95-21995d425853 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:37.477324 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-f2139bd6-3c6b-407b-8c95-21995d425853 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.170762 May 11 07:41:37.477917 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 198/393] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:37 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:37.537915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2781abf1-2456-4af7-98c1-b88be9cb19e2 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "POST /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/action" status: 200 len: 32 microversion: 2.1 time: 0.157554 May 11 07:41:37.538515 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 196/394] 10.222.0.36 () {60 vars in 1277 bytes} [Wed May 11 07:41:37 2022] POST /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 07:41:37.549279 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ee4cbe2b-6e38-4d84-b0e0-87bb548a3cd6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:37.549925 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ee4cbe2b-6e38-4d84-b0e0-87bb548a3cd6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:37.556143 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ee4cbe2b-6e38-4d84-b0e0-87bb548a3cd6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:37.556697 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ee4cbe2b-6e38-4d84-b0e0-87bb548a3cd6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:37.557726 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ee4cbe2b-6e38-4d84-b0e0-87bb548a3cd6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:37.558290 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ee4cbe2b-6e38-4d84-b0e0-87bb548a3cd6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:37.769020 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ee4cbe2b-6e38-4d84-b0e0-87bb548a3cd6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:37.777533 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ee4cbe2b-6e38-4d84-b0e0-87bb548a3cd6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.232051 May 11 07:41:37.778115 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 199/395] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:37 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:38.498230 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-fb183bc1-ba4f-407c-8938-767d0de2e6c6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:38.499427 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-fb183bc1-ba4f-407c-8938-767d0de2e6c6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:38.508374 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fb183bc1-ba4f-407c-8938-767d0de2e6c6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:38.508839 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fb183bc1-ba4f-407c-8938-767d0de2e6c6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:38.509798 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fb183bc1-ba4f-407c-8938-767d0de2e6c6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:38.510463 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fb183bc1-ba4f-407c-8938-767d0de2e6c6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:38.638635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-fb183bc1-ba4f-407c-8938-767d0de2e6c6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:38.647425 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-fb183bc1-ba4f-407c-8938-767d0de2e6c6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:38.648945 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-fb183bc1-ba4f-407c-8938-767d0de2e6c6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:38.650765 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-fb183bc1-ba4f-407c-8938-767d0de2e6c6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.158652 May 11 07:41:38.651320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 197/396] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:38 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:38.772509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-d7121262-f4df-42bd-aed8-eedb7a6a0c63 req-9583c97a-db4f-4883-8ba8-138b733810cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe41f4-cc5e-4cc7-bc04-ebff35bfd769", "name": "network-vif-plugged", "status": "completed", "tag": "1e8c8dbc-18a9-44e8-8ac6-273b984ed899"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:41:38.781463 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-d7121262-f4df-42bd-aed8-eedb7a6a0c63 req-9583c97a-db4f-4883-8ba8-138b733810cb service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:38.781934 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-d7121262-f4df-42bd-aed8-eedb7a6a0c63 req-9583c97a-db4f-4883-8ba8-138b733810cb service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:38.793647 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-d7121262-f4df-42bd-aed8-eedb7a6a0c63 req-9583c97a-db4f-4883-8ba8-138b733810cb service nova] Creating event network-vif-plugged:1e8c8dbc-18a9-44e8-8ac6-273b984ed899 for instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 on hv-cinder-83699 May 11 07:41:38.795639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-73f8dc6d-7818-4c3d-8284-21fcad5a4cda tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:38.796348 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-73f8dc6d-7818-4c3d-8284-21fcad5a4cda tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:38.798688 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-d7121262-f4df-42bd-aed8-eedb7a6a0c63 req-9583c97a-db4f-4883-8ba8-138b733810cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029760 May 11 07:41:38.799481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 200/397] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:41:38.803582 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-73f8dc6d-7818-4c3d-8284-21fcad5a4cda tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:38.804036 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-73f8dc6d-7818-4c3d-8284-21fcad5a4cda tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:38.804843 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-73f8dc6d-7818-4c3d-8284-21fcad5a4cda tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:38.805316 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-73f8dc6d-7818-4c3d-8284-21fcad5a4cda tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:38.934690 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-73f8dc6d-7818-4c3d-8284-21fcad5a4cda tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:38.942560 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-73f8dc6d-7818-4c3d-8284-21fcad5a4cda tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.150708 May 11 07:41:38.943116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 198/398] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:38 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:39.668950 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d7858a9a-d464-4dfa-a7b4-09d1e48e39d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:39.669731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d7858a9a-d464-4dfa-a7b4-09d1e48e39d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:39.676080 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d7858a9a-d464-4dfa-a7b4-09d1e48e39d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:39.676530 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d7858a9a-d464-4dfa-a7b4-09d1e48e39d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:39.677296 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d7858a9a-d464-4dfa-a7b4-09d1e48e39d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:39.677760 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d7858a9a-d464-4dfa-a7b4-09d1e48e39d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:39.811510 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d7858a9a-d464-4dfa-a7b4-09d1e48e39d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:39.820069 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d7858a9a-d464-4dfa-a7b4-09d1e48e39d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:39.822193 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d7858a9a-d464-4dfa-a7b4-09d1e48e39d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:39.823361 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d7858a9a-d464-4dfa-a7b4-09d1e48e39d5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.158940 May 11 07:41:39.823917 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 201/399] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:39 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:39.964601 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3efe1c4d-bed5-4fcd-8f5e-004c6d2a74b5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:39.965230 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3efe1c4d-bed5-4fcd-8f5e-004c6d2a74b5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:39.971460 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3efe1c4d-bed5-4fcd-8f5e-004c6d2a74b5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:39.971905 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3efe1c4d-bed5-4fcd-8f5e-004c6d2a74b5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:39.972668 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3efe1c4d-bed5-4fcd-8f5e-004c6d2a74b5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:39.973096 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3efe1c4d-bed5-4fcd-8f5e-004c6d2a74b5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:40.151875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3efe1c4d-bed5-4fcd-8f5e-004c6d2a74b5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:40.159662 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3efe1c4d-bed5-4fcd-8f5e-004c6d2a74b5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.199001 May 11 07:41:40.160218 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 199/400] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:39 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:40.841830 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-80f50415-76ef-4ae3-af7c-177ad65ef65e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:40.842436 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-80f50415-76ef-4ae3-af7c-177ad65ef65e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:40.848766 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-80f50415-76ef-4ae3-af7c-177ad65ef65e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:40.849387 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-80f50415-76ef-4ae3-af7c-177ad65ef65e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:40.850204 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-80f50415-76ef-4ae3-af7c-177ad65ef65e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:40.850636 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-80f50415-76ef-4ae3-af7c-177ad65ef65e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:40.986695 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-80f50415-76ef-4ae3-af7c-177ad65ef65e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:40.995400 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-80f50415-76ef-4ae3-af7c-177ad65ef65e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:40.996960 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-80f50415-76ef-4ae3-af7c-177ad65ef65e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:40.998301 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-80f50415-76ef-4ae3-af7c-177ad65ef65e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1807 microversion: 2.20 time: 0.161079 May 11 07:41:40.998924 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 202/401] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:40 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:41.176843 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7b9a5b78-9c20-47a7-a0d1-6ad85eb9e7bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:41.178119 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7b9a5b78-9c20-47a7-a0d1-6ad85eb9e7bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:41.185312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7b9a5b78-9c20-47a7-a0d1-6ad85eb9e7bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:41.185880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7b9a5b78-9c20-47a7-a0d1-6ad85eb9e7bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:41.186654 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7b9a5b78-9c20-47a7-a0d1-6ad85eb9e7bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:41.187098 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7b9a5b78-9c20-47a7-a0d1-6ad85eb9e7bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:41.367543 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7b9a5b78-9c20-47a7-a0d1-6ad85eb9e7bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:41.375876 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7b9a5b78-9c20-47a7-a0d1-6ad85eb9e7bd tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.202784 May 11 07:41:41.376453 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 200/402] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:41 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:41:42.016292 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-615c6017-78e2-406e-895c-54f4c2c570bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:42.016829 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-615c6017-78e2-406e-895c-54f4c2c570bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:42.023262 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-615c6017-78e2-406e-895c-54f4c2c570bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:42.023711 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-615c6017-78e2-406e-895c-54f4c2c570bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:42.024477 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-615c6017-78e2-406e-895c-54f4c2c570bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:42.025379 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-615c6017-78e2-406e-895c-54f4c2c570bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:42.155415 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-615c6017-78e2-406e-895c-54f4c2c570bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:42.163572 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-615c6017-78e2-406e-895c-54f4c2c570bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:42.165060 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-615c6017-78e2-406e-895c-54f4c2c570bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:42.166826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-615c6017-78e2-406e-895c-54f4c2c570bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1794 microversion: 2.20 time: 0.154576 May 11 07:41:42.167371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 203/403] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:41:42 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:41:42.393738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-21d019eb-fd62-48bf-96a2-4e2098e90e64 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:42.394346 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-21d019eb-fd62-48bf-96a2-4e2098e90e64 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:42.401137 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-21d019eb-fd62-48bf-96a2-4e2098e90e64 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:42.401614 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-21d019eb-fd62-48bf-96a2-4e2098e90e64 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:42.402387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-21d019eb-fd62-48bf-96a2-4e2098e90e64 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:42.402829 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-21d019eb-fd62-48bf-96a2-4e2098e90e64 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:42.544159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-21d019eb-fd62-48bf-96a2-4e2098e90e64 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:42.551986 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-21d019eb-fd62-48bf-96a2-4e2098e90e64 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.162046 May 11 07:41:42.552556 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 201/404] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:42 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:43.569153 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d0ab3f81-6c3a-4f53-bd88-47a5c47451ce tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:43.569808 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d0ab3f81-6c3a-4f53-bd88-47a5c47451ce tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:43.576015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d0ab3f81-6c3a-4f53-bd88-47a5c47451ce tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:43.576463 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d0ab3f81-6c3a-4f53-bd88-47a5c47451ce tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:43.577223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d0ab3f81-6c3a-4f53-bd88-47a5c47451ce tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:43.577685 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d0ab3f81-6c3a-4f53-bd88-47a5c47451ce tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:43.708808 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d0ab3f81-6c3a-4f53-bd88-47a5c47451ce tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:43.716987 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d0ab3f81-6c3a-4f53-bd88-47a5c47451ce tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.151801 May 11 07:41:43.717561 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 204/405] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:43 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:44.733275 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-68058f0a-3530-4be1-a788-c23c0e201828 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:44.733964 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-68058f0a-3530-4be1-a788-c23c0e201828 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:44.740351 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-68058f0a-3530-4be1-a788-c23c0e201828 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:44.740741 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-68058f0a-3530-4be1-a788-c23c0e201828 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:44.741526 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-68058f0a-3530-4be1-a788-c23c0e201828 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:44.741993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-68058f0a-3530-4be1-a788-c23c0e201828 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:44.867491 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-68058f0a-3530-4be1-a788-c23c0e201828 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:44.875909 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-68058f0a-3530-4be1-a788-c23c0e201828 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.146445 May 11 07:41:44.876465 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 202/406] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:44 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:45.892655 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-51e749ef-f3b0-4fc3-89dc-ffd181b74e43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:45.893171 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-51e749ef-f3b0-4fc3-89dc-ffd181b74e43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:45.899479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-51e749ef-f3b0-4fc3-89dc-ffd181b74e43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:45.899942 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-51e749ef-f3b0-4fc3-89dc-ffd181b74e43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:45.900692 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-51e749ef-f3b0-4fc3-89dc-ffd181b74e43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:45.901119 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-51e749ef-f3b0-4fc3-89dc-ffd181b74e43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:46.028565 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-51e749ef-f3b0-4fc3-89dc-ffd181b74e43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:46.036162 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-51e749ef-f3b0-4fc3-89dc-ffd181b74e43 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.147397 May 11 07:41:46.036715 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 205/407] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:45 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:47.053560 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9121886e-db29-4d89-80b9-6faba466ef31 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:47.054093 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9121886e-db29-4d89-80b9-6faba466ef31 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:47.060407 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9121886e-db29-4d89-80b9-6faba466ef31 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:47.060857 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9121886e-db29-4d89-80b9-6faba466ef31 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:47.061651 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9121886e-db29-4d89-80b9-6faba466ef31 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:47.062092 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9121886e-db29-4d89-80b9-6faba466ef31 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:47.188323 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9121886e-db29-4d89-80b9-6faba466ef31 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:47.196172 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9121886e-db29-4d89-80b9-6faba466ef31 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.146530 May 11 07:41:47.196725 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 203/408] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:47 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:48.213834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-f2e4a2ba-4981-4201-bb96-a0174074ac5d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:48.214491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-f2e4a2ba-4981-4201-bb96-a0174074ac5d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:48.220693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f2e4a2ba-4981-4201-bb96-a0174074ac5d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:48.221140 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f2e4a2ba-4981-4201-bb96-a0174074ac5d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:48.221935 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f2e4a2ba-4981-4201-bb96-a0174074ac5d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:48.222371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f2e4a2ba-4981-4201-bb96-a0174074ac5d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:48.346448 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-f2e4a2ba-4981-4201-bb96-a0174074ac5d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:48.354270 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-f2e4a2ba-4981-4201-bb96-a0174074ac5d tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.144346 May 11 07:41:48.355314 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 206/409] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:48 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:49.372214 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b8317eab-d2a8-4e1b-acf3-c23c2acea199 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:49.372826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-b8317eab-d2a8-4e1b-acf3-c23c2acea199 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:49.379412 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b8317eab-d2a8-4e1b-acf3-c23c2acea199 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:49.379944 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b8317eab-d2a8-4e1b-acf3-c23c2acea199 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:49.381019 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b8317eab-d2a8-4e1b-acf3-c23c2acea199 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:49.381454 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b8317eab-d2a8-4e1b-acf3-c23c2acea199 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:49.549345 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-b8317eab-d2a8-4e1b-acf3-c23c2acea199 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:49.557449 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-b8317eab-d2a8-4e1b-acf3-c23c2acea199 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.189555 May 11 07:41:49.558586 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 204/410] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:49 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:50.575960 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7d00de9f-a660-4294-af3c-20457beca399 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:50.576568 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-7d00de9f-a660-4294-af3c-20457beca399 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:50.584211 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7d00de9f-a660-4294-af3c-20457beca399 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:50.584661 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7d00de9f-a660-4294-af3c-20457beca399 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:50.585422 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7d00de9f-a660-4294-af3c-20457beca399 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:50.585878 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7d00de9f-a660-4294-af3c-20457beca399 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:50.785506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-7d00de9f-a660-4294-af3c-20457beca399 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:50.793617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-7d00de9f-a660-4294-af3c-20457beca399 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.221951 May 11 07:41:50.794186 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 207/411] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:50 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:51.810428 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9cd6975c-b6f3-42bc-aa30-bdd392a3b6d3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:51.811793 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9cd6975c-b6f3-42bc-aa30-bdd392a3b6d3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:51.820718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9cd6975c-b6f3-42bc-aa30-bdd392a3b6d3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:51.821275 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9cd6975c-b6f3-42bc-aa30-bdd392a3b6d3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:51.822318 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9cd6975c-b6f3-42bc-aa30-bdd392a3b6d3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:51.822830 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9cd6975c-b6f3-42bc-aa30-bdd392a3b6d3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:52.078704 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9cd6975c-b6f3-42bc-aa30-bdd392a3b6d3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:52.086444 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9cd6975c-b6f3-42bc-aa30-bdd392a3b6d3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.280355 May 11 07:41:52.087007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 205/412] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:51 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:53.104408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ccd81809-bce8-431c-9dc8-4af4f1e0fb22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:53.105722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ccd81809-bce8-431c-9dc8-4af4f1e0fb22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:53.112457 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ccd81809-bce8-431c-9dc8-4af4f1e0fb22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:53.113024 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ccd81809-bce8-431c-9dc8-4af4f1e0fb22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:53.113945 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ccd81809-bce8-431c-9dc8-4af4f1e0fb22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:53.114471 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ccd81809-bce8-431c-9dc8-4af4f1e0fb22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:53.249260 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ccd81809-bce8-431c-9dc8-4af4f1e0fb22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:53.257407 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ccd81809-bce8-431c-9dc8-4af4f1e0fb22 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.157275 May 11 07:41:53.258305 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 208/413] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:53 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:54.275672 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-47df1118-cdfe-4848-906a-c60e7943da6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:54.277564 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-47df1118-cdfe-4848-906a-c60e7943da6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:54.286438 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-47df1118-cdfe-4848-906a-c60e7943da6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:54.287148 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-47df1118-cdfe-4848-906a-c60e7943da6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:54.288113 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-47df1118-cdfe-4848-906a-c60e7943da6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:54.288776 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-47df1118-cdfe-4848-906a-c60e7943da6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:54.445899 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-47df1118-cdfe-4848-906a-c60e7943da6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:54.463256 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-47df1118-cdfe-4848-906a-c60e7943da6e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.191316 May 11 07:41:54.464077 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 206/414] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:54 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:55.486609 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d0e5d7fc-fd1c-4d1d-9f37-2b0ef03e4cf3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:55.488408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d0e5d7fc-fd1c-4d1d-9f37-2b0ef03e4cf3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:55.494462 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d0e5d7fc-fd1c-4d1d-9f37-2b0ef03e4cf3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:55.494969 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d0e5d7fc-fd1c-4d1d-9f37-2b0ef03e4cf3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:55.496277 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d0e5d7fc-fd1c-4d1d-9f37-2b0ef03e4cf3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:55.496717 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d0e5d7fc-fd1c-4d1d-9f37-2b0ef03e4cf3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:55.643479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d0e5d7fc-fd1c-4d1d-9f37-2b0ef03e4cf3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:55.651951 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d0e5d7fc-fd1c-4d1d-9f37-2b0ef03e4cf3 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.169006 May 11 07:41:55.662115 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 209/415] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:55 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:56.669343 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3a757d57-0a44-4b28-97c1-31098beaf712 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:56.671673 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3a757d57-0a44-4b28-97c1-31098beaf712 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:56.678034 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3a757d57-0a44-4b28-97c1-31098beaf712 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:56.678490 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3a757d57-0a44-4b28-97c1-31098beaf712 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:56.679460 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3a757d57-0a44-4b28-97c1-31098beaf712 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:56.679899 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3a757d57-0a44-4b28-97c1-31098beaf712 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:56.818988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3a757d57-0a44-4b28-97c1-31098beaf712 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:56.830014 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3a757d57-0a44-4b28-97c1-31098beaf712 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1737 microversion: 2.1 time: 0.164729 May 11 07:41:56.841995 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 207/416] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:56 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:57.848010 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-55390cef-b9cb-4b64-b8c5-b93fa8075a95 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:57.848531 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-55390cef-b9cb-4b64-b8c5-b93fa8075a95 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:57.855169 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-55390cef-b9cb-4b64-b8c5-b93fa8075a95 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:57.855894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-55390cef-b9cb-4b64-b8c5-b93fa8075a95 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:57.856839 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-55390cef-b9cb-4b64-b8c5-b93fa8075a95 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:57.857428 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-55390cef-b9cb-4b64-b8c5-b93fa8075a95 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:58.082266 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-55390cef-b9cb-4b64-b8c5-b93fa8075a95 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:58.105668 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-55390cef-b9cb-4b64-b8c5-b93fa8075a95 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1717 microversion: 2.1 time: 0.256115 May 11 07:41:58.112392 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 210/417] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:57 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1717 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:58.301760 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7dfc0b81-47c4-466e-a05d-88de6d9d3b71 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:58.302464 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7dfc0b81-47c4-466e-a05d-88de6d9d3b71 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:58.310245 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7dfc0b81-47c4-466e-a05d-88de6d9d3b71 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:58.310963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7dfc0b81-47c4-466e-a05d-88de6d9d3b71 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:58.313260 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7dfc0b81-47c4-466e-a05d-88de6d9d3b71 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:58.313929 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7dfc0b81-47c4-466e-a05d-88de6d9d3b71 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:58.536825 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-7dfc0b81-47c4-466e-a05d-88de6d9d3b71 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] HTTP exception thrown: Cannot 'detach_volume' instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 while it is in vm_state rescued May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7dfc0b81-47c4-466e-a05d-88de6d9d3b71 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Request method failure captured: May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: DELETE /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-volume_attachments/00688635-2dc2-43bd-a4e7-b721c82865c6 HTTP/1.1 May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2f4-oKoOE9FBE_RG9FyTwLAv71Px09UBPVP8kenpsEj9SvNzuf6dLSpds-XnOcgdDSjVYNcNr-a5d9Do_2WrjGr2ab1y3lCX6jNf_ktVP1a30PDbGS6tB9iHuA2uLFyNLZOALi5jjB7EvTJ0KtAwD21SpqDnA9bNus1EZRpHIAcMbE May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 5100c1cfe7f148058734c0da2d1497d4 May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:41:58.538754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:41:58.540054 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5100c1cfe7f148058734c0da2d1497d4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5100c1cfe7f148058734c0da2d1497d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5100c1cfe7f148058734c0da2d1497d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5100c1cfe7f148058734c0da2d1497d4"}]}] May 11 07:41:58.540054 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:41:58.540054 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 5100c1cfe7f148058734c0da2d1497d4 May 11 07:41:58.540054 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:41:58.540054 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-ServerRescueNegativeTestJSON-280701147-project May 11 07:41:58.540054 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:41:58.540054 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:41:58.540054 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: cb70f7eb7b44487a9ee3f331c83f9e31 May 11 07:41:58.540054 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-ServerRescueNegativeTestJSON-280701147-project May 11 07:41:58.540054 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:41:58.540054 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Cannot 'detach_volume' instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 while it is in vm_state rescued May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'server_id': 'a0b775a5-13c2-4d45-8015-d7a37683cfb1', 'id': '00688635-2dc2-43bd-a4e7-b721c82865c6'} May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:41:58.540716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 while it is in vm_state rescued May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 while it is in vm_state rescued May 11 07:41:58.541993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:41:58.544398 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7dfc0b81-47c4-466e-a05d-88de6d9d3b71 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Returning 409 to user: Cannot 'detach_volume' instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 while it is in vm_state rescued {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:41:58.545383 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7dfc0b81-47c4-466e-a05d-88de6d9d3b71 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-volume_attachments/00688635-2dc2-43bd-a4e7-b721c82865c6" status: 409 len: 152 microversion: 2.1 time: 0.262592 May 11 07:41:58.546423 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 208/418] 10.222.0.36 () {58 vars in 1415 bytes} [Wed May 11 07:41:58 2022] DELETE /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-volume_attachments/00688635-2dc2-43bd-a4e7-b721c82865c6 => generated 152 bytes in 265 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 11 07:41:58.555967 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-eaa16f8a-4af3-4bb0-ad04-7733933c5f2e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:41:58.556796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-eaa16f8a-4af3-4bb0-ad04-7733933c5f2e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:58.566737 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-eaa16f8a-4af3-4bb0-ad04-7733933c5f2e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:58.567687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-eaa16f8a-4af3-4bb0-ad04-7733933c5f2e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:58.568977 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-eaa16f8a-4af3-4bb0-ad04-7733933c5f2e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:58.569805 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-eaa16f8a-4af3-4bb0-ad04-7733933c5f2e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:58.703844 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-eaa16f8a-4af3-4bb0-ad04-7733933c5f2e tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "POST /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/action" status: 202 len: 0 microversion: 2.1 time: 0.152879 May 11 07:41:58.706927 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 211/419] 10.222.0.36 () {60 vars in 1277 bytes} [Wed May 11 07:41:58 2022] POST /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:41:58.718021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d391a5eb-7f7d-413e-9ee2-575386eecadb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:58.720932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d391a5eb-7f7d-413e-9ee2-575386eecadb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:58.750098 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d391a5eb-7f7d-413e-9ee2-575386eecadb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:58.751110 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d391a5eb-7f7d-413e-9ee2-575386eecadb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:58.752357 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d391a5eb-7f7d-413e-9ee2-575386eecadb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:58.752974 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d391a5eb-7f7d-413e-9ee2-575386eecadb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:58.811938 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-724c0fc9-2823-439c-b5e5-185a727b0f15 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:41:58.812894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-724c0fc9-2823-439c-b5e5-185a727b0f15 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:41:58.824215 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-724c0fc9-2823-439c-b5e5-185a727b0f15 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:58.825571 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-724c0fc9-2823-439c-b5e5-185a727b0f15 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:58.827685 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-724c0fc9-2823-439c-b5e5-185a727b0f15 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:41:58.828594 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-724c0fc9-2823-439c-b5e5-185a727b0f15 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:41:59.054204 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.objects.instance [None req-724c0fc9-2823-439c-b5e5-185a727b0f15 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lazy-loading 'services' on Instance uuid 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 {{(pid=123599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:41:59.269195 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d391a5eb-7f7d-413e-9ee2-575386eecadb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:41:59.287114 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d391a5eb-7f7d-413e-9ee2-575386eecadb tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1725 microversion: 2.1 time: 0.575287 May 11 07:41:59.289871 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 209/420] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:41:58 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1725 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:41:59.345881 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-724c0fc9-2823-439c-b5e5-185a727b0f15 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/os-volume_attachments/0ba86d77-35d0-4cee-af1e-384b9f038add" status: 202 len: 0 microversion: 2.1 time: 0.544897 May 11 07:41:59.346694 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 212/421] 10.222.0.36 () {58 vars in 1415 bytes} [Wed May 11 07:41:58 2022] DELETE /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/os-volume_attachments/0ba86d77-35d0-4cee-af1e-384b9f038add => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 07:42:00.306982 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-22e0c403-1196-4b83-b71a-9353e44a8637 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:00.307935 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-22e0c403-1196-4b83-b71a-9353e44a8637 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:00.314644 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-22e0c403-1196-4b83-b71a-9353e44a8637 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:00.315180 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-22e0c403-1196-4b83-b71a-9353e44a8637 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:00.316489 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-22e0c403-1196-4b83-b71a-9353e44a8637 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:00.316930 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-22e0c403-1196-4b83-b71a-9353e44a8637 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:00.579658 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-22e0c403-1196-4b83-b71a-9353e44a8637 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:00.591222 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-22e0c403-1196-4b83-b71a-9353e44a8637 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1725 microversion: 2.1 time: 0.285817 May 11 07:42:00.592078 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 210/422] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:00 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1725 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:00.607235 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-70d266f1-d43d-47b1-9ed0-a261a55a6935 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:00.614392 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-70d266f1-d43d-47b1-9ed0-a261a55a6935 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:00.615603 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-70d266f1-d43d-47b1-9ed0-a261a55a6935 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:00.691555 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-70d266f1-d43d-47b1-9ed0-a261a55a6935 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Going to try to stop instance {{(pid=123599) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 11 07:42:00.740880 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-70d266f1-d43d-47b1-9ed0-a261a55a6935 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "POST /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/action" status: 202 len: 0 microversion: 2.1 time: 0.138517 May 11 07:42:00.741670 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 213/423] 10.222.0.36 () {60 vars in 1277 bytes} [Wed May 11 07:42:00 2022] POST /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:42:00.750508 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-67442761-776c-4da9-bd3a-fd4d2f565c9a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:00.751199 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-67442761-776c-4da9-bd3a-fd4d2f565c9a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:00.757774 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-67442761-776c-4da9-bd3a-fd4d2f565c9a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:00.758323 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-67442761-776c-4da9-bd3a-fd4d2f565c9a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:00.759166 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-67442761-776c-4da9-bd3a-fd4d2f565c9a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:00.759610 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-67442761-776c-4da9-bd3a-fd4d2f565c9a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:00.897868 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-67442761-776c-4da9-bd3a-fd4d2f565c9a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:00.905780 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-67442761-776c-4da9-bd3a-fd4d2f565c9a tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.159312 May 11 07:42:00.906349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 211/424] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:00 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:01.611350 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-906e7c0e-e94d-46a2-beb0-ee107a0092d5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:01.614570 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-906e7c0e-e94d-46a2-beb0-ee107a0092d5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:01.621641 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-906e7c0e-e94d-46a2-beb0-ee107a0092d5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:01.622460 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-906e7c0e-e94d-46a2-beb0-ee107a0092d5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:01.623484 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-906e7c0e-e94d-46a2-beb0-ee107a0092d5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:01.624059 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-906e7c0e-e94d-46a2-beb0-ee107a0092d5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:01.808624 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-906e7c0e-e94d-46a2-beb0-ee107a0092d5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:01.817978 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-906e7c0e-e94d-46a2-beb0-ee107a0092d5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1725 microversion: 2.1 time: 0.211432 May 11 07:42:01.818733 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 214/425] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:01 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:01.923863 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f8654e57-3d5d-41ce-b241-a31349ab6c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:01.925719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f8654e57-3d5d-41ce-b241-a31349ab6c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:01.934937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f8654e57-3d5d-41ce-b241-a31349ab6c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:01.935783 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f8654e57-3d5d-41ce-b241-a31349ab6c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:01.936728 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f8654e57-3d5d-41ce-b241-a31349ab6c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:01.937661 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f8654e57-3d5d-41ce-b241-a31349ab6c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:02.130544 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f8654e57-3d5d-41ce-b241-a31349ab6c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:02.139748 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f8654e57-3d5d-41ce-b241-a31349ab6c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.220499 May 11 07:42:02.140316 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 212/426] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:01 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:02.835748 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-71ef53a8-a771-4592-a33c-26dd236f275c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:02.836346 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-71ef53a8-a771-4592-a33c-26dd236f275c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:02.873572 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-71ef53a8-a771-4592-a33c-26dd236f275c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:02.874841 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-71ef53a8-a771-4592-a33c-26dd236f275c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:02.878205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-71ef53a8-a771-4592-a33c-26dd236f275c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:02.882985 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-71ef53a8-a771-4592-a33c-26dd236f275c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:03.118892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-71ef53a8-a771-4592-a33c-26dd236f275c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:03.130485 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-71ef53a8-a771-4592-a33c-26dd236f275c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1731 microversion: 2.1 time: 0.297719 May 11 07:42:03.131820 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 215/427] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:02 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1731 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:03.149263 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d2567a04-e2e4-4d41-9d5d-f9deb976ba9a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:03.152454 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d2567a04-e2e4-4d41-9d5d-f9deb976ba9a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:03.163618 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d2567a04-e2e4-4d41-9d5d-f9deb976ba9a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:03.164068 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d2567a04-e2e4-4d41-9d5d-f9deb976ba9a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:03.171757 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d2567a04-e2e4-4d41-9d5d-f9deb976ba9a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:03.173991 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-59c13180-d70e-4d17-b424-05b4b9d73a0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:03.175074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d2567a04-e2e4-4d41-9d5d-f9deb976ba9a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:03.178354 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-59c13180-d70e-4d17-b424-05b4b9d73a0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:03.186465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-59c13180-d70e-4d17-b424-05b4b9d73a0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:03.192180 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-59c13180-d70e-4d17-b424-05b4b9d73a0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:03.193203 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-59c13180-d70e-4d17-b424-05b4b9d73a0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:03.194962 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-59c13180-d70e-4d17-b424-05b4b9d73a0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:03.335508 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d2567a04-e2e4-4d41-9d5d-f9deb976ba9a tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.189970 May 11 07:42:03.337636 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 213/428] 10.222.0.36 () {58 vars in 1274 bytes} [Wed May 11 07:42:03 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:42:03.411879 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-59c13180-d70e-4d17-b424-05b4b9d73a0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:03.422349 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-59c13180-d70e-4d17-b424-05b4b9d73a0c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.262186 May 11 07:42:03.423321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 216/429] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:03 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:04.439901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ee79d782-597b-4987-8ff0-546a0651fd1e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:04.441646 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-ee79d782-597b-4987-8ff0-546a0651fd1e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:04.449503 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ee79d782-597b-4987-8ff0-546a0651fd1e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:04.452364 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ee79d782-597b-4987-8ff0-546a0651fd1e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:04.453429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ee79d782-597b-4987-8ff0-546a0651fd1e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:04.454185 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ee79d782-597b-4987-8ff0-546a0651fd1e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:04.623143 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-ee79d782-597b-4987-8ff0-546a0651fd1e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:04.631449 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-ee79d782-597b-4987-8ff0-546a0651fd1e tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.195522 May 11 07:42:04.632596 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 214/430] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:04 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:04.862576 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-aea28069-a8aa-4b93-b5a3-dc4639b94afd req-0f7a9c74-b94d-409b-8b44-801796ce29cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b775a5-13c2-4d45-8015-d7a37683cfb1", "tag": "91543a14-0ae8-44e1-bba8-2b3a746fbae8"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:04.876417 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-aea28069-a8aa-4b93-b5a3-dc4639b94afd req-0f7a9c74-b94d-409b-8b44-801796ce29cc service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:04.876866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-aea28069-a8aa-4b93-b5a3-dc4639b94afd req-0f7a9c74-b94d-409b-8b44-801796ce29cc service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:04.896530 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-aea28069-a8aa-4b93-b5a3-dc4639b94afd req-0f7a9c74-b94d-409b-8b44-801796ce29cc service nova] Creating event network-changed:91543a14-0ae8-44e1-bba8-2b3a746fbae8 for instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 on hv-cinder-83699 May 11 07:42:04.903975 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-aea28069-a8aa-4b93-b5a3-dc4639b94afd req-0f7a9c74-b94d-409b-8b44-801796ce29cc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045197 May 11 07:42:04.908045 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 217/431] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:42:05.649311 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-39be1975-0d16-41d2-acb4-d8b3f2d6b156 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:05.650470 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-39be1975-0d16-41d2-acb4-d8b3f2d6b156 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:05.668122 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-39be1975-0d16-41d2-acb4-d8b3f2d6b156 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:05.669192 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-39be1975-0d16-41d2-acb4-d8b3f2d6b156 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:05.670539 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-39be1975-0d16-41d2-acb4-d8b3f2d6b156 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:05.674043 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-39be1975-0d16-41d2-acb4-d8b3f2d6b156 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:05.884900 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-39be1975-0d16-41d2-acb4-d8b3f2d6b156 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:05.892661 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-39be1975-0d16-41d2-acb4-d8b3f2d6b156 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.247213 May 11 07:42:05.894370 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 215/432] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:05 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:06.912345 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-64ad9d50-7a3d-4515-af14-2a1b056247c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:06.913057 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-64ad9d50-7a3d-4515-af14-2a1b056247c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:06.918679 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-78afcfb2-d7ec-455a-96ca-4c68c6a3ca57 req-878e8ec9-823e-4b28-893f-f9db791a89dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0b775a5-13c2-4d45-8015-d7a37683cfb1", "tag": "91543a14-0ae8-44e1-bba8-2b3a746fbae8"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:06.920542 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-64ad9d50-7a3d-4515-af14-2a1b056247c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:06.920997 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-64ad9d50-7a3d-4515-af14-2a1b056247c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:06.921860 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-64ad9d50-7a3d-4515-af14-2a1b056247c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:06.922488 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-64ad9d50-7a3d-4515-af14-2a1b056247c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:06.928111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-78afcfb2-d7ec-455a-96ca-4c68c6a3ca57 req-878e8ec9-823e-4b28-893f-f9db791a89dd service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:06.928845 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-78afcfb2-d7ec-455a-96ca-4c68c6a3ca57 req-878e8ec9-823e-4b28-893f-f9db791a89dd service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:06.942363 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-78afcfb2-d7ec-455a-96ca-4c68c6a3ca57 req-878e8ec9-823e-4b28-893f-f9db791a89dd service nova] Creating event network-changed:91543a14-0ae8-44e1-bba8-2b3a746fbae8 for instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 on hv-cinder-83699 May 11 07:42:06.948916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-78afcfb2-d7ec-455a-96ca-4c68c6a3ca57 req-878e8ec9-823e-4b28-893f-f9db791a89dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033488 May 11 07:42:06.952765 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 216/433] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:42:07.116550 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-64ad9d50-7a3d-4515-af14-2a1b056247c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:07.125844 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-64ad9d50-7a3d-4515-af14-2a1b056247c7 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.218000 May 11 07:42:07.126644 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 218/434] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:06 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:08.145200 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9f712b89-7567-46a2-97a6-265450e5bff0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:08.146533 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9f712b89-7567-46a2-97a6-265450e5bff0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:08.153073 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9f712b89-7567-46a2-97a6-265450e5bff0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:08.153885 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9f712b89-7567-46a2-97a6-265450e5bff0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:08.156270 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9f712b89-7567-46a2-97a6-265450e5bff0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:08.156919 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9f712b89-7567-46a2-97a6-265450e5bff0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:08.309565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9f712b89-7567-46a2-97a6-265450e5bff0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:08.317877 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9f712b89-7567-46a2-97a6-265450e5bff0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.178010 May 11 07:42:08.318454 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 217/435] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:08 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:09.335913 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-5ec29b49-a9db-41cb-bdb9-cf047947dbc0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:09.336587 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-5ec29b49-a9db-41cb-bdb9-cf047947dbc0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:09.343241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ec29b49-a9db-41cb-bdb9-cf047947dbc0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:09.343689 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ec29b49-a9db-41cb-bdb9-cf047947dbc0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:09.344442 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ec29b49-a9db-41cb-bdb9-cf047947dbc0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:09.344870 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ec29b49-a9db-41cb-bdb9-cf047947dbc0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:09.503556 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-5ec29b49-a9db-41cb-bdb9-cf047947dbc0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:09.513487 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-5ec29b49-a9db-41cb-bdb9-cf047947dbc0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.181252 May 11 07:42:09.514112 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 219/436] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:09 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:10.125704 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-22c02b22-569d-47c9-a279-c4d4f3a3bbf7 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Action: 'create', calling method: .version_select at 0x7f19ed2def70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1547629459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT8zhkTb1c3qy5HTXSPbJcCed2z+CiczT+ASgVLqTP8f0rDCuguiBmugiUl7blIunzTYgXCL7ZJjN2+An/xz6N2CyBmLOnYMnwKvTyvCEoqlhTmzV81G1xZ4NTpjV6axQ=="}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:10.143900 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-22c02b22-569d-47c9-a279-c4d4f3a3bbf7 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Getting quotas for project 03e1fa8f24714fc9af8b0947ec51aede. Resources: {'key_pairs'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:42:10.147722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-22c02b22-569d-47c9-a279-c4d4f3a3bbf7 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Getting quotas for user bdcfff1647ac4569b96ad948bf991c60 and project 03e1fa8f24714fc9af8b0947ec51aede. Resources: {'key_pairs'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:42:10.184187 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-22c02b22-569d-47c9-a279-c4d4f3a3bbf7 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062324 May 11 07:42:10.184814 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 218/437] 10.222.0.36 () {60 vars in 1158 bytes} [Wed May 11 07:42:10 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:42:10.232411 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1223019081", "imageRef": "4044c4ea-ccac-492c-9f66-51e2375d6a6c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1547629459", "networks": [{"uuid": "fb44a62c-df04-4422-b678-e6d535160d9f"}]}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:10.279656 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.network.neutron [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] validate_networks() for [('fb44a62c-df04-4422-b678-e6d535160d9f', None, None, None, None, None)] {{(pid=123599) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:42:10.531331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2a559fbb-36bb-43db-9da4-bd2d197b0ef2 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:10.531931 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2a559fbb-36bb-43db-9da4-bd2d197b0ef2 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:10.537716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2a559fbb-36bb-43db-9da4-bd2d197b0ef2 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:10.538167 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2a559fbb-36bb-43db-9da4-bd2d197b0ef2 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:10.538932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2a559fbb-36bb-43db-9da4-bd2d197b0ef2 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:10.539366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2a559fbb-36bb-43db-9da4-bd2d197b0ef2 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:10.684673 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Flavor limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:42:10.685178 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Image limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:42:10.685563 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Flavor pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:42:10.685994 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Image pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:42:10.686397 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:42:10.695026 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:10.695461 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:10.696248 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:10.696672 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:10.712167 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-2a559fbb-36bb-43db-9da4-bd2d197b0ef2 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:10.712384 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Getting quotas for project 03e1fa8f24714fc9af8b0947ec51aede. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:42:10.716769 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Getting quotas for user bdcfff1647ac4569b96ad948bf991c60 and project 03e1fa8f24714fc9af8b0947ec51aede. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:42:10.720011 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2a559fbb-36bb-43db-9da4-bd2d197b0ef2 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.192620 May 11 07:42:10.720570 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 219/438] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:10 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:42:10.727391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Going to run 1 instances... {{(pid=123599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:42:10.730233 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4044c4ea-ccac-492c-9f66-51e2375d6a6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:42:10.775122 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-fe601069-608f-4203-9336-b44f80ef392e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546966 May 11 07:42:10.775752 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 220/439] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:42:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:42:10.786189 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a2f87b52-d3a6-4be0-be3c-746b141de59a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:10.786801 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a2f87b52-d3a6-4be0-be3c-746b141de59a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:10.839353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a2f87b52-d3a6-4be0-be3c-746b141de59a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:10.845909 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a2f87b52-d3a6-4be0-be3c-746b141de59a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1259 microversion: 2.1 time: 0.063631 May 11 07:42:10.846568 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 220/440] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:10 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1259 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:11.738535 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0d1a56c6-ca24-4a64-b299-bfa47f5f9ab8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:11.739061 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0d1a56c6-ca24-4a64-b299-bfa47f5f9ab8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:11.745754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0d1a56c6-ca24-4a64-b299-bfa47f5f9ab8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:11.746206 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0d1a56c6-ca24-4a64-b299-bfa47f5f9ab8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:11.746977 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0d1a56c6-ca24-4a64-b299-bfa47f5f9ab8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:11.747409 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0d1a56c6-ca24-4a64-b299-bfa47f5f9ab8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:11.863211 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d6bdc1cc-910a-4303-b859-639e202eb8a2 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:11.863959 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d6bdc1cc-910a-4303-b859-639e202eb8a2 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:11.871618 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d6bdc1cc-910a-4303-b859-639e202eb8a2 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:11.872154 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d6bdc1cc-910a-4303-b859-639e202eb8a2 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:11.873022 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d6bdc1cc-910a-4303-b859-639e202eb8a2 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:11.873531 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d6bdc1cc-910a-4303-b859-639e202eb8a2 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:11.980850 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0d1a56c6-ca24-4a64-b299-bfa47f5f9ab8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:11.984588 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d6bdc1cc-910a-4303-b859-639e202eb8a2 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:11.988919 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0d1a56c6-ca24-4a64-b299-bfa47f5f9ab8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.254836 May 11 07:42:11.999426 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d6bdc1cc-910a-4303-b859-639e202eb8a2 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1317 microversion: 2.1 time: 0.134034 May 11 07:42:11.999426 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 221/441] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:11 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:12.000047 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 221/442] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:11 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:42:13.007362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b6037d16-db1b-44e9-a422-b913341ab2e4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:13.008744 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-b6037d16-db1b-44e9-a422-b913341ab2e4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:13.011412 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c27a75da-238b-4f87-a8e1-b9a38d800600 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:13.012512 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-c27a75da-238b-4f87-a8e1-b9a38d800600 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:13.016206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b6037d16-db1b-44e9-a422-b913341ab2e4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:13.016781 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b6037d16-db1b-44e9-a422-b913341ab2e4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:13.017709 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b6037d16-db1b-44e9-a422-b913341ab2e4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:13.018250 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b6037d16-db1b-44e9-a422-b913341ab2e4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:13.019586 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c27a75da-238b-4f87-a8e1-b9a38d800600 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:13.020042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c27a75da-238b-4f87-a8e1-b9a38d800600 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:13.020868 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c27a75da-238b-4f87-a8e1-b9a38d800600 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:13.021516 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c27a75da-238b-4f87-a8e1-b9a38d800600 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:13.215784 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-c27a75da-238b-4f87-a8e1-b9a38d800600 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:13.222385 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-b6037d16-db1b-44e9-a422-b913341ab2e4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:13.227850 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c27a75da-238b-4f87-a8e1-b9a38d800600 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.220646 May 11 07:42:13.228620 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 222/443] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:13 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:13.230421 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-b6037d16-db1b-44e9-a422-b913341ab2e4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.227062 May 11 07:42:13.230984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 222/444] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:13 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:14.244946 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-1de9cf6b-11ed-453f-a66c-3ca223a35d7a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:14.247417 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-1de9cf6b-11ed-453f-a66c-3ca223a35d7a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:14.248173 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a9c36f96-262c-4a46-9b86-49b95c542db3 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:14.248790 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a9c36f96-262c-4a46-9b86-49b95c542db3 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:14.255218 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a9c36f96-262c-4a46-9b86-49b95c542db3 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:14.255505 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1de9cf6b-11ed-453f-a66c-3ca223a35d7a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:14.255959 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1de9cf6b-11ed-453f-a66c-3ca223a35d7a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:14.256384 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a9c36f96-262c-4a46-9b86-49b95c542db3 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:14.256749 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1de9cf6b-11ed-453f-a66c-3ca223a35d7a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:14.257184 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1de9cf6b-11ed-453f-a66c-3ca223a35d7a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:14.257721 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a9c36f96-262c-4a46-9b86-49b95c542db3 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:14.258319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a9c36f96-262c-4a46-9b86-49b95c542db3 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:14.461758 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a9c36f96-262c-4a46-9b86-49b95c542db3 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:14.464543 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-1de9cf6b-11ed-453f-a66c-3ca223a35d7a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:14.470698 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a9c36f96-262c-4a46-9b86-49b95c542db3 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.226735 May 11 07:42:14.471341 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 223/445] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:14 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:42:14.476762 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-1de9cf6b-11ed-453f-a66c-3ca223a35d7a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.235680 May 11 07:42:14.481264 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 223/446] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:14 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:15.488122 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-390517b9-c855-4e52-b9f4-afddbb23f71c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:15.488726 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-390517b9-c855-4e52-b9f4-afddbb23f71c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:15.493842 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c36ffa10-588b-48ef-b74a-462e5b28efb6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:15.494513 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-c36ffa10-588b-48ef-b74a-462e5b28efb6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:15.495047 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-390517b9-c855-4e52-b9f4-afddbb23f71c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:15.495494 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-390517b9-c855-4e52-b9f4-afddbb23f71c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:15.496255 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-390517b9-c855-4e52-b9f4-afddbb23f71c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:15.496886 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-390517b9-c855-4e52-b9f4-afddbb23f71c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:15.501670 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c36ffa10-588b-48ef-b74a-462e5b28efb6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:15.502124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c36ffa10-588b-48ef-b74a-462e5b28efb6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:15.502956 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c36ffa10-588b-48ef-b74a-462e5b28efb6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:15.503706 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c36ffa10-588b-48ef-b74a-462e5b28efb6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:15.693906 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-c36ffa10-588b-48ef-b74a-462e5b28efb6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:15.701828 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c36ffa10-588b-48ef-b74a-462e5b28efb6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.211935 May 11 07:42:15.705973 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 224/447] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:15 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:15.711789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-390517b9-c855-4e52-b9f4-afddbb23f71c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:15.719226 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-390517b9-c855-4e52-b9f4-afddbb23f71c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.234864 May 11 07:42:15.719980 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 224/448] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:15 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:16.719318 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d09c3fe1-3e3c-4d3b-b0cb-4d559912bd73 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:16.719924 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d09c3fe1-3e3c-4d3b-b0cb-4d559912bd73 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:16.726286 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d09c3fe1-3e3c-4d3b-b0cb-4d559912bd73 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:16.726733 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d09c3fe1-3e3c-4d3b-b0cb-4d559912bd73 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:16.727495 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d09c3fe1-3e3c-4d3b-b0cb-4d559912bd73 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:16.727928 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d09c3fe1-3e3c-4d3b-b0cb-4d559912bd73 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:16.735892 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3cba6f7f-2ba5-4b14-8841-531a6a51d88c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:16.736545 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3cba6f7f-2ba5-4b14-8841-531a6a51d88c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:16.742673 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3cba6f7f-2ba5-4b14-8841-531a6a51d88c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:16.743121 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3cba6f7f-2ba5-4b14-8841-531a6a51d88c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:16.743877 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3cba6f7f-2ba5-4b14-8841-531a6a51d88c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:16.744310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3cba6f7f-2ba5-4b14-8841-531a6a51d88c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:16.912480 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d09c3fe1-3e3c-4d3b-b0cb-4d559912bd73 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:16.920630 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d09c3fe1-3e3c-4d3b-b0cb-4d559912bd73 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.205749 May 11 07:42:16.921435 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 225/449] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:16 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:42:16.937995 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3cba6f7f-2ba5-4b14-8841-531a6a51d88c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:16.946260 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3cba6f7f-2ba5-4b14-8841-531a6a51d88c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.213989 May 11 07:42:16.946839 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 225/450] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:16 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:42:17.937631 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d02966bc-adf7-44c4-8902-24bcb039e91e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:17.938344 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d02966bc-adf7-44c4-8902-24bcb039e91e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:17.945532 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d02966bc-adf7-44c4-8902-24bcb039e91e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:17.946045 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d02966bc-adf7-44c4-8902-24bcb039e91e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:17.947465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d02966bc-adf7-44c4-8902-24bcb039e91e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:17.947898 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d02966bc-adf7-44c4-8902-24bcb039e91e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:17.965448 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c6953541-eb5d-49a5-a9da-26c165541f7c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:17.966165 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c6953541-eb5d-49a5-a9da-26c165541f7c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:17.972457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c6953541-eb5d-49a5-a9da-26c165541f7c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:17.972901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c6953541-eb5d-49a5-a9da-26c165541f7c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:17.973721 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c6953541-eb5d-49a5-a9da-26c165541f7c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:17.974183 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c6953541-eb5d-49a5-a9da-26c165541f7c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:18.168654 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d02966bc-adf7-44c4-8902-24bcb039e91e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:18.175921 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d02966bc-adf7-44c4-8902-24bcb039e91e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.242185 May 11 07:42:18.176489 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 226/451] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:17 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:18.184781 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c6953541-eb5d-49a5-a9da-26c165541f7c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:18.192549 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c6953541-eb5d-49a5-a9da-26c165541f7c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.231676 May 11 07:42:18.193063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 226/452] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:17 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:19.193655 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-cd2127d9-7b10-407c-b912-9afcf0be4acd tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:19.194429 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-cd2127d9-7b10-407c-b912-9afcf0be4acd tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:19.200829 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cd2127d9-7b10-407c-b912-9afcf0be4acd tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:19.201275 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cd2127d9-7b10-407c-b912-9afcf0be4acd tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:19.202075 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cd2127d9-7b10-407c-b912-9afcf0be4acd tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:19.202524 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cd2127d9-7b10-407c-b912-9afcf0be4acd tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:19.209566 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-59442332-5713-4958-99d3-c9725bd68f01 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:19.211125 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-59442332-5713-4958-99d3-c9725bd68f01 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:19.219857 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-59442332-5713-4958-99d3-c9725bd68f01 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:19.220413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-59442332-5713-4958-99d3-c9725bd68f01 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:19.221461 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-59442332-5713-4958-99d3-c9725bd68f01 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:19.222021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-59442332-5713-4958-99d3-c9725bd68f01 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:19.413564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-cd2127d9-7b10-407c-b912-9afcf0be4acd tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:19.415250 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-59442332-5713-4958-99d3-c9725bd68f01 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:19.424912 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-59442332-5713-4958-99d3-c9725bd68f01 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.219263 May 11 07:42:19.434844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 227/453] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:19 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:19.438081 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-cd2127d9-7b10-407c-b912-9afcf0be4acd tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.249080 May 11 07:42:19.445690 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 227/454] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:19 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:20.443515 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7b2850bc-fa8c-40e6-8a2c-67d5816f6b73 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:20.444379 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7b2850bc-fa8c-40e6-8a2c-67d5816f6b73 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:20.453026 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7b2850bc-fa8c-40e6-8a2c-67d5816f6b73 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:20.453479 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7b2850bc-fa8c-40e6-8a2c-67d5816f6b73 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:20.454283 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7b2850bc-fa8c-40e6-8a2c-67d5816f6b73 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:20.454718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7b2850bc-fa8c-40e6-8a2c-67d5816f6b73 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:20.456265 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2fe33ddc-b5de-460f-a4c4-bb1638d35fee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:20.456944 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2fe33ddc-b5de-460f-a4c4-bb1638d35fee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:20.463412 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2fe33ddc-b5de-460f-a4c4-bb1638d35fee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:20.464148 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2fe33ddc-b5de-460f-a4c4-bb1638d35fee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:20.465725 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2fe33ddc-b5de-460f-a4c4-bb1638d35fee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:20.466158 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2fe33ddc-b5de-460f-a4c4-bb1638d35fee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:20.655045 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2fe33ddc-b5de-460f-a4c4-bb1638d35fee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:20.656566 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7b2850bc-fa8c-40e6-8a2c-67d5816f6b73 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:20.663088 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2fe33ddc-b5de-460f-a4c4-bb1638d35fee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.211000 May 11 07:42:20.663664 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 228/455] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:20 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:42:20.663816 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7b2850bc-fa8c-40e6-8a2c-67d5816f6b73 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1675 microversion: 2.1 time: 0.224848 May 11 07:42:20.664420 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 228/456] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:20 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:21.679962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-dafdead1-fd6e-45cd-80f1-df0f2a10e653 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:21.680689 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a3994d22-1ebc-4c6d-95a8-5e101d5f049d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:21.681070 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-dafdead1-fd6e-45cd-80f1-df0f2a10e653 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:21.681160 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a3994d22-1ebc-4c6d-95a8-5e101d5f049d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:21.687385 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-dafdead1-fd6e-45cd-80f1-df0f2a10e653 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:21.687629 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a3994d22-1ebc-4c6d-95a8-5e101d5f049d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:21.687910 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a3994d22-1ebc-4c6d-95a8-5e101d5f049d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:21.688091 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-dafdead1-fd6e-45cd-80f1-df0f2a10e653 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:21.688626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a3994d22-1ebc-4c6d-95a8-5e101d5f049d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:21.688881 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-dafdead1-fd6e-45cd-80f1-df0f2a10e653 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:21.689060 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a3994d22-1ebc-4c6d-95a8-5e101d5f049d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:21.689329 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-dafdead1-fd6e-45cd-80f1-df0f2a10e653 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:22.046830 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a3994d22-1ebc-4c6d-95a8-5e101d5f049d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:22.054312 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a3994d22-1ebc-4c6d-95a8-5e101d5f049d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.378163 May 11 07:42:22.054883 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 229/457] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:21 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:22.080963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-dafdead1-fd6e-45cd-80f1-df0f2a10e653 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:22.088177 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-dafdead1-fd6e-45cd-80f1-df0f2a10e653 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1652 microversion: 2.1 time: 0.412018 May 11 07:42:22.088741 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 229/458] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:21 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1652 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:22.105305 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ab8314d7-93bb-474a-982c-b6f251a2cdc4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:22.111061 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ab8314d7-93bb-474a-982c-b6f251a2cdc4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:22.111508 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ab8314d7-93bb-474a-982c-b6f251a2cdc4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:22.133346 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ab8314d7-93bb-474a-982c-b6f251a2cdc4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Going to try to start instance {{(pid=123599) start /opt/stack/nova/nova/compute/api.py:2730}} May 11 07:42:22.176045 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ab8314d7-93bb-474a-982c-b6f251a2cdc4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "POST /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/action" status: 202 len: 0 microversion: 2.1 time: 0.074348 May 11 07:42:22.176832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 230/459] 10.222.0.36 () {60 vars in 1277 bytes} [Wed May 11 07:42:22 2022] POST /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:42:22.185711 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8f707c29-3b91-4092-9410-505692c18d24 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:22.186331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8f707c29-3b91-4092-9410-505692c18d24 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:22.193458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f707c29-3b91-4092-9410-505692c18d24 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:22.194075 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f707c29-3b91-4092-9410-505692c18d24 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:22.194965 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f707c29-3b91-4092-9410-505692c18d24 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:22.195436 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f707c29-3b91-4092-9410-505692c18d24 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:22.426273 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8f707c29-3b91-4092-9410-505692c18d24 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:22.437009 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8f707c29-3b91-4092-9410-505692c18d24 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1661 microversion: 2.1 time: 0.255225 May 11 07:42:22.437827 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 230/460] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:22 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1661 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:22.603688 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-fc94c096-50ba-4f3f-92f8-fd9a288953c0 req-a85df8fb-73a9-49a5-a8c3-2d868c2161b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5d5c60-3790-4889-92a4-0bd325a22b43", "tag": "2986b04c-bb85-422f-a436-abb58852a5fc"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:22.623567 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-fc94c096-50ba-4f3f-92f8-fd9a288953c0 req-a85df8fb-73a9-49a5-a8c3-2d868c2161b6 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:22.624021 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-fc94c096-50ba-4f3f-92f8-fd9a288953c0 req-a85df8fb-73a9-49a5-a8c3-2d868c2161b6 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:22.640718 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-fc94c096-50ba-4f3f-92f8-fd9a288953c0 req-a85df8fb-73a9-49a5-a8c3-2d868c2161b6 service nova] Creating event network-changed:2986b04c-bb85-422f-a436-abb58852a5fc for instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 on hv-cinder-83699 May 11 07:42:22.645778 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-fc94c096-50ba-4f3f-92f8-fd9a288953c0 req-a85df8fb-73a9-49a5-a8c3-2d868c2161b6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049981 May 11 07:42:22.648683 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 231/461] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:42:23.071276 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8f884d5e-a4df-4274-bd11-4b2b64c917a9 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:23.071881 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8f884d5e-a4df-4274-bd11-4b2b64c917a9 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:23.078211 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f884d5e-a4df-4274-bd11-4b2b64c917a9 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:23.078602 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f884d5e-a4df-4274-bd11-4b2b64c917a9 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:23.079363 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f884d5e-a4df-4274-bd11-4b2b64c917a9 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:23.079794 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f884d5e-a4df-4274-bd11-4b2b64c917a9 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:23.206805 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8f884d5e-a4df-4274-bd11-4b2b64c917a9 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:23.214120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8f884d5e-a4df-4274-bd11-4b2b64c917a9 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.146504 May 11 07:42:23.215337 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 231/462] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:23 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:23.456184 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-14eb9c96-923b-4497-ba6a-dd5ea0a3c4c9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:23.456881 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-14eb9c96-923b-4497-ba6a-dd5ea0a3c4c9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:23.463051 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-14eb9c96-923b-4497-ba6a-dd5ea0a3c4c9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:23.463499 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-14eb9c96-923b-4497-ba6a-dd5ea0a3c4c9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:23.464258 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-14eb9c96-923b-4497-ba6a-dd5ea0a3c4c9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:23.465368 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-14eb9c96-923b-4497-ba6a-dd5ea0a3c4c9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:23.587190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-14eb9c96-923b-4497-ba6a-dd5ea0a3c4c9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:23.594995 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-14eb9c96-923b-4497-ba6a-dd5ea0a3c4c9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1661 microversion: 2.1 time: 0.143451 May 11 07:42:23.595555 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 232/463] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:23 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1661 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:23.856913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-043301f0-8c34-4c57-876e-d1254cf2077d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:23.857343 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-043301f0-8c34-4c57-876e-d1254cf2077d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:23.863401 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-043301f0-8c34-4c57-876e-d1254cf2077d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:23.863841 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-043301f0-8c34-4c57-876e-d1254cf2077d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:23.864594 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-043301f0-8c34-4c57-876e-d1254cf2077d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:23.865025 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-043301f0-8c34-4c57-876e-d1254cf2077d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:23.893249 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-043301f0-8c34-4c57-876e-d1254cf2077d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/os-volume_attachments/9c06adbd-0e43-4f61-835a-10186b99587e" status: 200 len: 194 microversion: 2.20 time: 0.040397 May 11 07:42:23.893877 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 232/464] 10.222.0.36 () {60 vars in 1453 bytes} [Wed May 11 07:42:23 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/os-volume_attachments/9c06adbd-0e43-4f61-835a-10186b99587e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:42:23.954791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-048e456b-dae4-40ee-a6d9-62a590198401 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:23.955314 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-048e456b-dae4-40ee-a6d9-62a590198401 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:23.961119 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-048e456b-dae4-40ee-a6d9-62a590198401 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:23.961594 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-048e456b-dae4-40ee-a6d9-62a590198401 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:23.962359 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-048e456b-dae4-40ee-a6d9-62a590198401 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:23.962793 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-048e456b-dae4-40ee-a6d9-62a590198401 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:24.038992 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.objects.instance [None req-048e456b-dae4-40ee-a6d9-62a590198401 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lazy-loading 'services' on Instance uuid acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 {{(pid=123599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:42:24.109392 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-048e456b-dae4-40ee-a6d9-62a590198401 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "DELETE /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/os-volume_attachments/9c06adbd-0e43-4f61-835a-10186b99587e" status: 202 len: 0 microversion: 2.20 time: 0.158438 May 11 07:42:24.110043 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 233/465] 10.222.0.36 () {60 vars in 1456 bytes} [Wed May 11 07:42:23 2022] DELETE /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/os-volume_attachments/9c06adbd-0e43-4f61-835a-10186b99587e => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 07:42:24.118408 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-12cf80d7-cd44-4f41-8191-ae6512032221 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:24.119697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-12cf80d7-cd44-4f41-8191-ae6512032221 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:24.126826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-12cf80d7-cd44-4f41-8191-ae6512032221 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:24.127850 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-12cf80d7-cd44-4f41-8191-ae6512032221 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:24.128678 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-12cf80d7-cd44-4f41-8191-ae6512032221 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:24.129119 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-12cf80d7-cd44-4f41-8191-ae6512032221 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:24.165200 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-12cf80d7-cd44-4f41-8191-ae6512032221 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050737 May 11 07:42:24.165994 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 233/466] 10.222.0.36 () {60 vars in 1342 bytes} [Wed May 11 07:42:24 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:42:24.232302 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3aa22c21-e74a-41d8-a3a6-622202a6b1b0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:24.233036 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-3aa22c21-e74a-41d8-a3a6-622202a6b1b0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:24.239178 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3aa22c21-e74a-41d8-a3a6-622202a6b1b0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:24.239630 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3aa22c21-e74a-41d8-a3a6-622202a6b1b0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:24.240403 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3aa22c21-e74a-41d8-a3a6-622202a6b1b0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:24.240836 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3aa22c21-e74a-41d8-a3a6-622202a6b1b0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:24.365152 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-3aa22c21-e74a-41d8-a3a6-622202a6b1b0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:24.372992 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-3aa22c21-e74a-41d8-a3a6-622202a6b1b0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.145458 May 11 07:42:24.373574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 234/467] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:24 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:42:24.613635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3e5961cc-a04d-4ef7-971e-87fdf07c2297 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:24.614609 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3e5961cc-a04d-4ef7-971e-87fdf07c2297 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:24.620850 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3e5961cc-a04d-4ef7-971e-87fdf07c2297 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:24.621308 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3e5961cc-a04d-4ef7-971e-87fdf07c2297 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:24.622126 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3e5961cc-a04d-4ef7-971e-87fdf07c2297 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:24.622572 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3e5961cc-a04d-4ef7-971e-87fdf07c2297 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:24.778684 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3e5961cc-a04d-4ef7-971e-87fdf07c2297 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:24.786428 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3e5961cc-a04d-4ef7-971e-87fdf07c2297 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1665 microversion: 2.1 time: 0.178246 May 11 07:42:24.786989 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 234/468] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:24 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1665 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:25.177604 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b117e796-a664-4b6e-b779-a16673aff1d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:25.178642 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-b117e796-a664-4b6e-b779-a16673aff1d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:25.184830 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b117e796-a664-4b6e-b779-a16673aff1d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:25.185279 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b117e796-a664-4b6e-b779-a16673aff1d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:25.186067 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b117e796-a664-4b6e-b779-a16673aff1d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:25.186501 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b117e796-a664-4b6e-b779-a16673aff1d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:25.218168 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-b117e796-a664-4b6e-b779-a16673aff1d3 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044505 May 11 07:42:25.218915 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 235/469] 10.222.0.36 () {60 vars in 1342 bytes} [Wed May 11 07:42:25 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:42:25.442883 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-bd155c92-4612-4ccf-aadd-d4b4da5b125a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:25.443524 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-bd155c92-4612-4ccf-aadd-d4b4da5b125a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:25.450015 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bd155c92-4612-4ccf-aadd-d4b4da5b125a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:25.450399 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bd155c92-4612-4ccf-aadd-d4b4da5b125a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:25.451818 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bd155c92-4612-4ccf-aadd-d4b4da5b125a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:25.452263 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bd155c92-4612-4ccf-aadd-d4b4da5b125a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:25.578710 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-bd155c92-4612-4ccf-aadd-d4b4da5b125a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:25.585877 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-bd155c92-4612-4ccf-aadd-d4b4da5b125a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.147108 May 11 07:42:25.586429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 235/470] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:25 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:42:26.229792 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-1536a9cb-9c03-4e37-b545-fecaf9a1a949 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:26.230698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-1536a9cb-9c03-4e37-b545-fecaf9a1a949 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:26.236988 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1536a9cb-9c03-4e37-b545-fecaf9a1a949 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:26.237602 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1536a9cb-9c03-4e37-b545-fecaf9a1a949 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:26.238362 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1536a9cb-9c03-4e37-b545-fecaf9a1a949 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:26.238789 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1536a9cb-9c03-4e37-b545-fecaf9a1a949 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:26.266653 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-1536a9cb-9c03-4e37-b545-fecaf9a1a949 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040792 May 11 07:42:26.267113 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 236/471] 10.222.0.36 () {60 vars in 1342 bytes} [Wed May 11 07:42:26 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:26.322111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8d4284b9-cc59-4f89-a17e-6a723e74df9b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:26.322608 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8d4284b9-cc59-4f89-a17e-6a723e74df9b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:26.329039 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8d4284b9-cc59-4f89-a17e-6a723e74df9b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:26.329487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8d4284b9-cc59-4f89-a17e-6a723e74df9b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:26.330274 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8d4284b9-cc59-4f89-a17e-6a723e74df9b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:26.330713 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8d4284b9-cc59-4f89-a17e-6a723e74df9b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:26.355420 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8d4284b9-cc59-4f89-a17e-6a723e74df9b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Going to try to terminate instance {{(pid=123600) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:42:26.428295 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8d4284b9-cc59-4f89-a17e-6a723e74df9b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "DELETE /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 204 len: 0 microversion: 2.20 time: 0.109737 May 11 07:42:26.432093 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 236/472] 10.222.0.36 () {60 vars in 1279 bytes} [Wed May 11 07:42:26 2022] DELETE /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 07:42:26.439407 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0470c069-12af-40e6-a6fc-ff2f96abfe83 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:26.440027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0470c069-12af-40e6-a6fc-ff2f96abfe83 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:26.446287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0470c069-12af-40e6-a6fc-ff2f96abfe83 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:26.446715 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0470c069-12af-40e6-a6fc-ff2f96abfe83 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:26.447466 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0470c069-12af-40e6-a6fc-ff2f96abfe83 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:26.447891 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0470c069-12af-40e6-a6fc-ff2f96abfe83 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:26.570464 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0470c069-12af-40e6-a6fc-ff2f96abfe83 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:26.578588 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0470c069-12af-40e6-a6fc-ff2f96abfe83 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:26.580077 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0470c069-12af-40e6-a6fc-ff2f96abfe83 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:26.581206 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0470c069-12af-40e6-a6fc-ff2f96abfe83 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.147702 May 11 07:42:26.581795 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 237/473] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:26 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:26.602208 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-95d81f84-c3a7-4d5f-8689-6493ad29508d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:26.602906 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-95d81f84-c3a7-4d5f-8689-6493ad29508d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:26.609232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-95d81f84-c3a7-4d5f-8689-6493ad29508d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:26.609731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-95d81f84-c3a7-4d5f-8689-6493ad29508d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:26.610495 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-95d81f84-c3a7-4d5f-8689-6493ad29508d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:26.610930 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-95d81f84-c3a7-4d5f-8689-6493ad29508d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:26.734035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-95d81f84-c3a7-4d5f-8689-6493ad29508d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:26.741210 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-95d81f84-c3a7-4d5f-8689-6493ad29508d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.143234 May 11 07:42:26.741806 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 237/474] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:26 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:27.599303 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0123d749-ffbe-4992-a9f0-b6dd5b6ab7d9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:27.599913 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0123d749-ffbe-4992-a9f0-b6dd5b6ab7d9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:27.606290 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0123d749-ffbe-4992-a9f0-b6dd5b6ab7d9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:27.606757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0123d749-ffbe-4992-a9f0-b6dd5b6ab7d9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:27.607511 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0123d749-ffbe-4992-a9f0-b6dd5b6ab7d9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:27.607946 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0123d749-ffbe-4992-a9f0-b6dd5b6ab7d9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:27.734040 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0123d749-ffbe-4992-a9f0-b6dd5b6ab7d9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:27.741761 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0123d749-ffbe-4992-a9f0-b6dd5b6ab7d9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:27.743242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0123d749-ffbe-4992-a9f0-b6dd5b6ab7d9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:27.744392 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0123d749-ffbe-4992-a9f0-b6dd5b6ab7d9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.148977 May 11 07:42:27.744943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 238/475] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:27 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:27.758206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-654a1c33-fcc0-4631-8339-693ae7301100 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:27.758812 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-654a1c33-fcc0-4631-8339-693ae7301100 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:27.765772 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-654a1c33-fcc0-4631-8339-693ae7301100 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:27.766224 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-654a1c33-fcc0-4631-8339-693ae7301100 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:27.766981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-654a1c33-fcc0-4631-8339-693ae7301100 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:27.767412 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-654a1c33-fcc0-4631-8339-693ae7301100 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:27.895117 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-654a1c33-fcc0-4631-8339-693ae7301100 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:27.902278 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-654a1c33-fcc0-4631-8339-693ae7301100 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.147809 May 11 07:42:27.902830 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 238/476] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:27 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:28.763016 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-4e0f6c48-f5bc-4c04-8759-15c02806beb5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:28.763631 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-4e0f6c48-f5bc-4c04-8759-15c02806beb5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:28.769871 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4e0f6c48-f5bc-4c04-8759-15c02806beb5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:28.770315 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4e0f6c48-f5bc-4c04-8759-15c02806beb5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:28.771080 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4e0f6c48-f5bc-4c04-8759-15c02806beb5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:28.771514 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4e0f6c48-f5bc-4c04-8759-15c02806beb5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:28.908601 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-4e0f6c48-f5bc-4c04-8759-15c02806beb5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:28.922072 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c1616c03-83e0-47a5-b50a-4534dd3cb441 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:28.923751 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c1616c03-83e0-47a5-b50a-4534dd3cb441 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:28.930347 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c1616c03-83e0-47a5-b50a-4534dd3cb441 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:28.930808 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c1616c03-83e0-47a5-b50a-4534dd3cb441 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:28.934941 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-4e0f6c48-f5bc-4c04-8759-15c02806beb5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:28.937188 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-4e0f6c48-f5bc-4c04-8759-15c02806beb5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:28.938443 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-4e0f6c48-f5bc-4c04-8759-15c02806beb5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1722 microversion: 2.20 time: 0.179303 May 11 07:42:28.939241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 239/477] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:28 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:28.940332 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c1616c03-83e0-47a5-b50a-4534dd3cb441 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:28.940942 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c1616c03-83e0-47a5-b50a-4534dd3cb441 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:29.017393 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-f1b47ebf-fc6f-49e3-ba23-5136bbd035c2 req-1eac97b7-4a56-4665-b113-78b1bf28229a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5d5c60-3790-4889-92a4-0bd325a22b43", "name": "network-vif-plugged", "status": "completed", "tag": "2986b04c-bb85-422f-a436-abb58852a5fc"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:29.027976 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-f1b47ebf-fc6f-49e3-ba23-5136bbd035c2 req-1eac97b7-4a56-4665-b113-78b1bf28229a service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:29.032042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-f1b47ebf-fc6f-49e3-ba23-5136bbd035c2 req-1eac97b7-4a56-4665-b113-78b1bf28229a service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:29.049384 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-f1b47ebf-fc6f-49e3-ba23-5136bbd035c2 req-1eac97b7-4a56-4665-b113-78b1bf28229a service nova] Creating event network-vif-plugged:2986b04c-bb85-422f-a436-abb58852a5fc for instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 on hv-cinder-83699 May 11 07:42:29.055968 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-f1b47ebf-fc6f-49e3-ba23-5136bbd035c2 req-1eac97b7-4a56-4665-b113-78b1bf28229a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042410 May 11 07:42:29.056602 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 240/478] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:42:29.095119 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c1616c03-83e0-47a5-b50a-4534dd3cb441 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:29.113241 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c1616c03-83e0-47a5-b50a-4534dd3cb441 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.196862 May 11 07:42:29.115128 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 239/479] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:28 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:29.416521 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-831fed71-a1c6-4f28-875e-cfbd406b64c2 req-54991449-c457-4c22-88d1-6a36aec30378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe41f4-cc5e-4cc7-bc04-ebff35bfd769", "name": "network-vif-deleted", "tag": "1e8c8dbc-18a9-44e8-8ac6-273b984ed899"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:29.428338 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-831fed71-a1c6-4f28-875e-cfbd406b64c2 req-54991449-c457-4c22-88d1-6a36aec30378 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:29.429034 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-831fed71-a1c6-4f28-875e-cfbd406b64c2 req-54991449-c457-4c22-88d1-6a36aec30378 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:29.450174 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-831fed71-a1c6-4f28-875e-cfbd406b64c2 req-54991449-c457-4c22-88d1-6a36aec30378 service nova] Creating event network-vif-deleted:1e8c8dbc-18a9-44e8-8ac6-273b984ed899 for instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 on hv-cinder-83699 May 11 07:42:29.461352 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-831fed71-a1c6-4f28-875e-cfbd406b64c2 req-54991449-c457-4c22-88d1-6a36aec30378 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049526 May 11 07:42:29.478725 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 241/480] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:42:29.959354 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d630b963-7761-4a2f-a426-cf52178f0bd9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:29.960038 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d630b963-7761-4a2f-a426-cf52178f0bd9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:29.966568 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d630b963-7761-4a2f-a426-cf52178f0bd9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:29.967028 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d630b963-7761-4a2f-a426-cf52178f0bd9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:29.968074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d630b963-7761-4a2f-a426-cf52178f0bd9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:29.968516 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d630b963-7761-4a2f-a426-cf52178f0bd9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:30.000160 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d630b963-7761-4a2f-a426-cf52178f0bd9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:30.000522 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d630b963-7761-4a2f-a426-cf52178f0bd9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:30.001028 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.objects.instance [None req-d630b963-7761-4a2f-a426-cf52178f0bd9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lazy-loading 'fault' on Instance uuid acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 {{(pid=123600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:42:30.046192 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d630b963-7761-4a2f-a426-cf52178f0bd9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:30.053990 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d630b963-7761-4a2f-a426-cf52178f0bd9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:30.055487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d630b963-7761-4a2f-a426-cf52178f0bd9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:30.056608 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d630b963-7761-4a2f-a426-cf52178f0bd9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 200 len: 1371 microversion: 2.20 time: 0.101963 May 11 07:42:30.057375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 240/481] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:29 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:30.137625 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-e3812968-41bb-47e0-95a8-9522111da150 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:30.138474 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-e3812968-41bb-47e0-95a8-9522111da150 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:30.147930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e3812968-41bb-47e0-95a8-9522111da150 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:30.148363 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e3812968-41bb-47e0-95a8-9522111da150 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:30.149467 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e3812968-41bb-47e0-95a8-9522111da150 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:30.150153 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e3812968-41bb-47e0-95a8-9522111da150 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:30.288156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-e3812968-41bb-47e0-95a8-9522111da150 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:30.296270 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-e3812968-41bb-47e0-95a8-9522111da150 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.168737 May 11 07:42:30.297452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 242/482] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:30 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:42:31.076474 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-48a7e67b-10f6-441c-a46d-57de1f7e8150 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:31.078297 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-48a7e67b-10f6-441c-a46d-57de1f7e8150 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:31.085062 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-48a7e67b-10f6-441c-a46d-57de1f7e8150 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:31.085516 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-48a7e67b-10f6-441c-a46d-57de1f7e8150 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:31.086322 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-48a7e67b-10f6-441c-a46d-57de1f7e8150 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:31.086767 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-48a7e67b-10f6-441c-a46d-57de1f7e8150 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:31.100672 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-48a7e67b-10f6-441c-a46d-57de1f7e8150 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] HTTP exception thrown: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-48a7e67b-10f6-441c-a46d-57de1f7e8150 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Request method failure captured: May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 HTTP/1.1 May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2f3v84IZYnek7zcw0tLHLZpD6JOAeQvBcoLWjFTheTiJdvY4jW4_aJpACbxVCHUXSDJMwX4jtKCGxALwsMnKLf5vGzaLkPI9x0RYTuB_2NOtuaN8bm7d5uwHt6isBDRnYPw-m9mYCi6NbFUVrRMjKTqmHlhoMp-_VPl36SPSCBOHrw May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Openstack-Nova-Api-Version: 2.20 May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 075ba180d52b46ad9cd3334520bcfb89 May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:42:31.102350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:42:31.104021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_075ba180d52b46ad9cd3334520bcfb89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/075ba180d52b46ad9cd3334520bcfb89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/075ba180d52b46ad9cd3334520bcfb89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/075ba180d52b46ad9cd3334520bcfb89"}]}] May 11 07:42:31.104021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:42:31.104021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 075ba180d52b46ad9cd3334520bcfb89 May 11 07:42:31.104021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:42:31.104021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-AttachVolumeShelveTestJSON-1490332633-project May 11 07:42:31.104021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:42:31.104021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:42:31.104021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: c6bb9dabb1fc46dda1fe1906ab248c57 May 11 07:42:31.104021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490332633-project May 11 07:42:31.104021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:42:31.104021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:42:31.104021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': 'acfe41f4-cc5e-4cc7-bc04-ebff35bfd769'} May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:42:31.104891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:42:31.106361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:42:31.107751 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-48a7e67b-10f6-441c-a46d-57de1f7e8150 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Returning 404 to user: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:42:31.107751 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-48a7e67b-10f6-441c-a46d-57de1f7e8150 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 404 len: 111 microversion: 2.20 time: 0.031430 May 11 07:42:31.107751 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 241/483] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:31 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 07:42:31.112686 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0fd28eca-fba3-4f24-b01d-98d831a7de5e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '.version_select at 0x7f19ec8fe940>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:31.132307 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0fd28eca-fba3-4f24-b01d-98d831a7de5e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-104399395" status: 204 len: 0 microversion: 2.20 time: 0.023268 May 11 07:42:31.132874 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 243/484] 10.222.0.36 () {60 vars in 1258 bytes} [Wed May 11 07:42:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-104399395 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 07:42:31.313670 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e4cfe5d6-a411-44e2-b990-61ef88615e67 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:31.314279 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e4cfe5d6-a411-44e2-b990-61ef88615e67 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:31.320770 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e4cfe5d6-a411-44e2-b990-61ef88615e67 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:31.321448 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e4cfe5d6-a411-44e2-b990-61ef88615e67 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:31.322635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e4cfe5d6-a411-44e2-b990-61ef88615e67 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:31.323190 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e4cfe5d6-a411-44e2-b990-61ef88615e67 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:31.560572 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e4cfe5d6-a411-44e2-b990-61ef88615e67 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:31.570764 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e4cfe5d6-a411-44e2-b990-61ef88615e67 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1359 microversion: 2.1 time: 0.260975 May 11 07:42:31.571727 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 242/485] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:31 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:31.869276 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-895e0314-3dec-47e4-9fa9-bd912d076c7f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Action: 'create', calling method: .version_select at 0x7f19eca9a790>, body: {"keypair": {"name": "tempest-keypair-509589221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiRQ2+QSZaU3fE40Q9iTiFsmkHxWxwnG/7YD2YIe/6c7Z5IVLLv9OornMgmQTiSlEWKtk26LsIDQEULF0CPpH2u6UsKKd1ZT57BKBwKbCRphNEUgBg1822EOgzJvWuJzA=="}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:31.883826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-895e0314-3dec-47e4-9fa9-bd912d076c7f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Getting quotas for project 075ba180d52b46ad9cd3334520bcfb89. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:42:31.887617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-895e0314-3dec-47e4-9fa9-bd912d076c7f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Getting quotas for user c6bb9dabb1fc46dda1fe1906ab248c57 and project 075ba180d52b46ad9cd3334520bcfb89. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:42:31.911028 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-895e0314-3dec-47e4-9fa9-bd912d076c7f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045680 May 11 07:42:31.911724 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 244/486] 10.222.0.36 () {62 vars in 1199 bytes} [Wed May 11 07:42:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 11 07:42:32.588410 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c3da4b99-ea10-4748-8d9e-da0bfe5bf00b tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:32.588972 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c3da4b99-ea10-4748-8d9e-da0bfe5bf00b tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:32.596289 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c3da4b99-ea10-4748-8d9e-da0bfe5bf00b tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:32.596747 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c3da4b99-ea10-4748-8d9e-da0bfe5bf00b tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:32.597583 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c3da4b99-ea10-4748-8d9e-da0bfe5bf00b tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:32.598028 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c3da4b99-ea10-4748-8d9e-da0bfe5bf00b tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:32.732418 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c3da4b99-ea10-4748-8d9e-da0bfe5bf00b tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:32.739711 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c3da4b99-ea10-4748-8d9e-da0bfe5bf00b tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1550 microversion: 2.1 time: 0.155302 May 11 07:42:32.740302 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 243/487] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:32 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:32.756797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-632bce6a-ebf6-48f4-8fda-d5922718bf10 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:32.757407 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-632bce6a-ebf6-48f4-8fda-d5922718bf10 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:32.763213 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-632bce6a-ebf6-48f4-8fda-d5922718bf10 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:32.763677 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-632bce6a-ebf6-48f4-8fda-d5922718bf10 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:32.764488 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-632bce6a-ebf6-48f4-8fda-d5922718bf10 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:32.765410 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-632bce6a-ebf6-48f4-8fda-d5922718bf10 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:32.897164 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-632bce6a-ebf6-48f4-8fda-d5922718bf10 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:32.905174 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-632bce6a-ebf6-48f4-8fda-d5922718bf10 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1550 microversion: 2.1 time: 0.151971 May 11 07:42:32.905772 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 245/488] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:32 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:32.920911 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3a9db307-68d8-4091-8062-a2710791975d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:32.925973 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3a9db307-68d8-4091-8062-a2710791975d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:32.927017 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3a9db307-68d8-4091-8062-a2710791975d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Searching by: {'deleted': False, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede'} {{(pid=123600) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 11 07:42:32.933843 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3a9db307-68d8-4091-8062-a2710791975d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:32.934411 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3a9db307-68d8-4091-8062-a2710791975d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:32.935291 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3a9db307-68d8-4091-8062-a2710791975d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:32.935804 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3a9db307-68d8-4091-8062-a2710791975d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:33.028166 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.multi_cell_list [None req-3a9db307-68d8-4091-8062-a2710791975d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123600) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 11 07:42:33.126033 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3a9db307-68d8-4091-8062-a2710791975d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208730 May 11 07:42:33.126510 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 244/489] 10.222.0.36 () {58 vars in 1124 bytes} [Wed May 11 07:42:32 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:42:33.136503 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-10c3bca5-1db9-423a-b239-d2f401fe4e87 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:33.137106 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-10c3bca5-1db9-423a-b239-d2f401fe4e87 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:33.143474 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-10c3bca5-1db9-423a-b239-d2f401fe4e87 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:33.143922 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-10c3bca5-1db9-423a-b239-d2f401fe4e87 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:33.144680 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-10c3bca5-1db9-423a-b239-d2f401fe4e87 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:33.145111 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-10c3bca5-1db9-423a-b239-d2f401fe4e87 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:33.272923 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-10c3bca5-1db9-423a-b239-d2f401fe4e87 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:33.280803 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-10c3bca5-1db9-423a-b239-d2f401fe4e87 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1550 microversion: 2.1 time: 0.147590 May 11 07:42:33.285835 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 246/490] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:33 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:33.412502 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1854640973", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a507c15c-cc52-449f-920c-1f23d1b31239"}], "security_groups": [{"name": "tempest-securitygroup--943770460"}], "key_name": "tempest-keypair-509589221", "user_data": "}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:33.523318 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.network.neutron [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] validate_networks() for [('a507c15c-cc52-449f-920c-1f23d1b31239', None, None, None, None, None)] {{(pid=123600) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:42:33.886241 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Flavor limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:42:33.886824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Image limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:42:33.887163 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Flavor pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:42:33.887574 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Image pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:42:33.887985 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:42:33.897011 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:33.897464 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:33.898304 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:33.898745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:33.915693 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Getting quotas for project 075ba180d52b46ad9cd3334520bcfb89. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:42:33.919722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Getting quotas for user c6bb9dabb1fc46dda1fe1906ab248c57 and project 075ba180d52b46ad9cd3334520bcfb89. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:42:33.930978 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Going to run 1 instances... {{(pid=123600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:42:33.933802 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:42:33.980148 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2352ab7e-02b4-4275-8c29-494a1da28980 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.571869 May 11 07:42:33.980829 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 245/491] 10.222.0.36 () {62 vars in 1187 bytes} [Wed May 11 07:42:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 11 07:42:33.990706 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-86022bfa-08eb-453a-b456-b7a6218869e0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:33.991317 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-86022bfa-08eb-453a-b456-b7a6218869e0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:34.047685 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-86022bfa-08eb-453a-b456-b7a6218869e0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:34.054917 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-86022bfa-08eb-453a-b456-b7a6218869e0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:34.056496 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-86022bfa-08eb-453a-b456-b7a6218869e0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:34.057628 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-86022bfa-08eb-453a-b456-b7a6218869e0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1281 microversion: 2.20 time: 0.070807 May 11 07:42:34.058186 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 247/492] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:33 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:34.783891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-aa180396-d401-49a6-a98c-f582900b451f tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d377314e-619c-4561-98b4-a5ad42bec256"}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:34.785049 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-aa180396-d401-49a6-a98c-f582900b451f tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:34.791890 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aa180396-d401-49a6-a98c-f582900b451f tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:34.792336 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aa180396-d401-49a6-a98c-f582900b451f tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:34.793096 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aa180396-d401-49a6-a98c-f582900b451f tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:34.793528 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aa180396-d401-49a6-a98c-f582900b451f tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:35.067480 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-aa180396-d401-49a6-a98c-f582900b451f tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "POST /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287268 May 11 07:42:35.068254 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 246/493] 10.222.0.36 () {60 vars in 1322 bytes} [Wed May 11 07:42:34 2022] POST /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:42:35.078605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-cce865bb-0284-40f4-a62f-494a4e90b9fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:35.079204 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-cce865bb-0284-40f4-a62f-494a4e90b9fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:35.087292 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cce865bb-0284-40f4-a62f-494a4e90b9fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:35.088036 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cce865bb-0284-40f4-a62f-494a4e90b9fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:35.088840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cce865bb-0284-40f4-a62f-494a4e90b9fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:35.089286 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cce865bb-0284-40f4-a62f-494a4e90b9fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:35.180224 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-cce865bb-0284-40f4-a62f-494a4e90b9fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:35.188515 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-cce865bb-0284-40f4-a62f-494a4e90b9fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:35.190090 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-cce865bb-0284-40f4-a62f-494a4e90b9fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:35.191651 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-cce865bb-0284-40f4-a62f-494a4e90b9fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1339 microversion: 2.20 time: 0.117391 May 11 07:42:35.192253 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 248/494] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:35 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1339 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:36.214464 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8370ece4-3c67-4790-b493-1eca1a2c2c60 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:36.215175 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8370ece4-3c67-4790-b493-1eca1a2c2c60 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:36.224562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8370ece4-3c67-4790-b493-1eca1a2c2c60 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:36.225021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8370ece4-3c67-4790-b493-1eca1a2c2c60 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:36.225853 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8370ece4-3c67-4790-b493-1eca1a2c2c60 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:36.226295 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8370ece4-3c67-4790-b493-1eca1a2c2c60 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:36.416976 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-9e3aea94-1bdd-4754-a9fe-641e73c2f2f7 req-e85dc279-2052-4493-bb41-0083902d6c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03c4e26-68ab-49e2-ac51-aa3bce79d3e7", "tag": "c341b877-b342-4956-94f6-3c4bcad3497f"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:36.426077 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8370ece4-3c67-4790-b493-1eca1a2c2c60 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:36.427994 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-9e3aea94-1bdd-4754-a9fe-641e73c2f2f7 req-e85dc279-2052-4493-bb41-0083902d6c18 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:36.428712 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-9e3aea94-1bdd-4754-a9fe-641e73c2f2f7 req-e85dc279-2052-4493-bb41-0083902d6c18 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:36.440879 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8370ece4-3c67-4790-b493-1eca1a2c2c60 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:36.442862 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-9e3aea94-1bdd-4754-a9fe-641e73c2f2f7 req-e85dc279-2052-4493-bb41-0083902d6c18 service nova] Creating event network-changed:c341b877-b342-4956-94f6-3c4bcad3497f for instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 on hv-cinder-83699 May 11 07:42:36.443958 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8370ece4-3c67-4790-b493-1eca1a2c2c60 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:36.445149 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8370ece4-3c67-4790-b493-1eca1a2c2c60 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1406 microversion: 2.20 time: 0.237218 May 11 07:42:36.455347 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 247/495] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:36 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:36.466120 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-9e3aea94-1bdd-4754-a9fe-641e73c2f2f7 req-e85dc279-2052-4493-bb41-0083902d6c18 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053318 May 11 07:42:36.467036 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 249/496] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:42:37.463228 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-60c16a10-410b-4506-9062-844f2f05efb7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:37.463743 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-60c16a10-410b-4506-9062-844f2f05efb7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:37.470243 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-60c16a10-410b-4506-9062-844f2f05efb7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:37.470699 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-60c16a10-410b-4506-9062-844f2f05efb7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:37.471464 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-60c16a10-410b-4506-9062-844f2f05efb7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:37.471902 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-60c16a10-410b-4506-9062-844f2f05efb7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:37.598339 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-60c16a10-410b-4506-9062-844f2f05efb7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:37.606057 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-60c16a10-410b-4506-9062-844f2f05efb7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:37.607559 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-60c16a10-410b-4506-9062-844f2f05efb7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:37.609129 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-60c16a10-410b-4506-9062-844f2f05efb7 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1406 microversion: 2.20 time: 0.149854 May 11 07:42:37.609740 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 248/497] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:37 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:38.628318 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a722f142-68a5-4853-9454-32e55172bedd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:38.629015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a722f142-68a5-4853-9454-32e55172bedd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:38.635268 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a722f142-68a5-4853-9454-32e55172bedd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:38.635717 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a722f142-68a5-4853-9454-32e55172bedd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:38.636484 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a722f142-68a5-4853-9454-32e55172bedd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:38.636915 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a722f142-68a5-4853-9454-32e55172bedd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:38.762877 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a722f142-68a5-4853-9454-32e55172bedd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:38.770622 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a722f142-68a5-4853-9454-32e55172bedd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:38.772126 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a722f142-68a5-4853-9454-32e55172bedd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:38.773219 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a722f142-68a5-4853-9454-32e55172bedd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1406 microversion: 2.20 time: 0.150174 May 11 07:42:38.773803 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 250/498] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:38 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:39.791375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d1aa1dd8-8832-4891-8e46-370a471f0b87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:39.792023 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d1aa1dd8-8832-4891-8e46-370a471f0b87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:39.798608 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d1aa1dd8-8832-4891-8e46-370a471f0b87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:39.799062 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d1aa1dd8-8832-4891-8e46-370a471f0b87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:39.799828 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d1aa1dd8-8832-4891-8e46-370a471f0b87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:39.800267 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d1aa1dd8-8832-4891-8e46-370a471f0b87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:39.924404 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d1aa1dd8-8832-4891-8e46-370a471f0b87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:39.932073 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d1aa1dd8-8832-4891-8e46-370a471f0b87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:39.933591 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d1aa1dd8-8832-4891-8e46-370a471f0b87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:39.934684 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d1aa1dd8-8832-4891-8e46-370a471f0b87 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1406 microversion: 2.20 time: 0.147169 May 11 07:42:39.935264 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 249/499] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:39 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:40.953619 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-fe0f3a84-d2c8-469e-b317-040046566c50 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:40.954299 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-fe0f3a84-d2c8-469e-b317-040046566c50 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:40.961452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fe0f3a84-d2c8-469e-b317-040046566c50 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:40.961931 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fe0f3a84-d2c8-469e-b317-040046566c50 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:40.962693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fe0f3a84-d2c8-469e-b317-040046566c50 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:40.963126 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fe0f3a84-d2c8-469e-b317-040046566c50 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:41.096035 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-fe0f3a84-d2c8-469e-b317-040046566c50 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:41.103791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-fe0f3a84-d2c8-469e-b317-040046566c50 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:41.105279 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-fe0f3a84-d2c8-469e-b317-040046566c50 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:41.106390 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-fe0f3a84-d2c8-469e-b317-040046566c50 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1406 microversion: 2.20 time: 0.156993 May 11 07:42:41.106950 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 251/500] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:40 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 07:42:42.124921 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c81e3fec-ad29-414e-86c8-2b8269b77bd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:42.125442 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c81e3fec-ad29-414e-86c8-2b8269b77bd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:42.131688 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c81e3fec-ad29-414e-86c8-2b8269b77bd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:42.132130 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c81e3fec-ad29-414e-86c8-2b8269b77bd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:42.132887 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c81e3fec-ad29-414e-86c8-2b8269b77bd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:42.133320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c81e3fec-ad29-414e-86c8-2b8269b77bd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:42.260402 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c81e3fec-ad29-414e-86c8-2b8269b77bd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:42.268051 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c81e3fec-ad29-414e-86c8-2b8269b77bd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:42.269568 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c81e3fec-ad29-414e-86c8-2b8269b77bd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:42.270659 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c81e3fec-ad29-414e-86c8-2b8269b77bd2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1406 microversion: 2.20 time: 0.150276 May 11 07:42:42.271211 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 250/501] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:42 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:42.629791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-13a3c1ad-cd6a-46ec-922f-9e1a86bacde8 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:42.630434 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-13a3c1ad-cd6a-46ec-922f-9e1a86bacde8 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:42.636675 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-13a3c1ad-cd6a-46ec-922f-9e1a86bacde8 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:42.637121 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-13a3c1ad-cd6a-46ec-922f-9e1a86bacde8 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:42.637923 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-13a3c1ad-cd6a-46ec-922f-9e1a86bacde8 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:42.638355 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-13a3c1ad-cd6a-46ec-922f-9e1a86bacde8 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:42.766307 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-13a3c1ad-cd6a-46ec-922f-9e1a86bacde8 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:42.774010 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-13a3c1ad-cd6a-46ec-922f-9e1a86bacde8 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1596 microversion: 2.1 time: 0.148049 May 11 07:42:42.774579 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 252/502] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:42 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1596 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:42.814375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2ff5d52b-61e2-42f8-b34f-d3bca4caa26c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:42.814860 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2ff5d52b-61e2-42f8-b34f-d3bca4caa26c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:42.821219 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2ff5d52b-61e2-42f8-b34f-d3bca4caa26c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:42.821706 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2ff5d52b-61e2-42f8-b34f-d3bca4caa26c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:42.822483 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2ff5d52b-61e2-42f8-b34f-d3bca4caa26c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:42.822914 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2ff5d52b-61e2-42f8-b34f-d3bca4caa26c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:42.902396 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.objects.instance [None req-2ff5d52b-61e2-42f8-b34f-d3bca4caa26c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lazy-loading 'services' on Instance uuid a0b775a5-13c2-4d45-8015-d7a37683cfb1 {{(pid=123600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:42:43.025523 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2ff5d52b-61e2-42f8-b34f-d3bca4caa26c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-volume_attachments/00688635-2dc2-43bd-a4e7-b721c82865c6" status: 202 len: 0 microversion: 2.1 time: 0.214683 May 11 07:42:43.026641 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 251/503] 10.222.0.36 () {58 vars in 1415 bytes} [Wed May 11 07:42:42 2022] DELETE /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-volume_attachments/00688635-2dc2-43bd-a4e7-b721c82865c6 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:42:43.035131 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ae0db6bb-3669-4dac-b7c5-d045e183a43f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:43.036408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ae0db6bb-3669-4dac-b7c5-d045e183a43f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:43.043746 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ae0db6bb-3669-4dac-b7c5-d045e183a43f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:43.044447 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ae0db6bb-3669-4dac-b7c5-d045e183a43f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:43.045672 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ae0db6bb-3669-4dac-b7c5-d045e183a43f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:43.046335 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ae0db6bb-3669-4dac-b7c5-d045e183a43f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:43.082198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-865f4f09-1f4f-4cfb-b68b-bea7f8e396f9 req-17bcb08b-c595-411d-a0cf-845749f729ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03c4e26-68ab-49e2-ac51-aa3bce79d3e7", "name": "network-vif-plugged", "status": "completed", "tag": "c341b877-b342-4956-94f6-3c4bcad3497f"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:43.082428 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ae0db6bb-3669-4dac-b7c5-d045e183a43f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051109 May 11 07:42:43.083332 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 253/504] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:42:43 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:42:43.090259 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-865f4f09-1f4f-4cfb-b68b-bea7f8e396f9 req-17bcb08b-c595-411d-a0cf-845749f729ca service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:43.090728 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-865f4f09-1f4f-4cfb-b68b-bea7f8e396f9 req-17bcb08b-c595-411d-a0cf-845749f729ca service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:43.104061 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-865f4f09-1f4f-4cfb-b68b-bea7f8e396f9 req-17bcb08b-c595-411d-a0cf-845749f729ca service nova] Creating event network-vif-plugged:c341b877-b342-4956-94f6-3c4bcad3497f for instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 on hv-cinder-83699 May 11 07:42:43.109298 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-865f4f09-1f4f-4cfb-b68b-bea7f8e396f9 req-17bcb08b-c595-411d-a0cf-845749f729ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031744 May 11 07:42:43.110479 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 252/505] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:42:43.288842 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ece0a8f8-921f-4108-bbbb-778e98db651a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:43.289518 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ece0a8f8-921f-4108-bbbb-778e98db651a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:43.295667 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ece0a8f8-921f-4108-bbbb-778e98db651a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:43.296119 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ece0a8f8-921f-4108-bbbb-778e98db651a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:43.296882 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ece0a8f8-921f-4108-bbbb-778e98db651a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:43.297315 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ece0a8f8-921f-4108-bbbb-778e98db651a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:43.426643 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ece0a8f8-921f-4108-bbbb-778e98db651a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:43.434498 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ece0a8f8-921f-4108-bbbb-778e98db651a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:43.436604 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ece0a8f8-921f-4108-bbbb-778e98db651a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:43.437818 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ece0a8f8-921f-4108-bbbb-778e98db651a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1406 microversion: 2.20 time: 0.153491 May 11 07:42:43.438377 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 254/506] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:43 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:44.096141 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-328c1dd5-aec4-4bf7-b2b6-4afa55847985 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:44.097142 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-328c1dd5-aec4-4bf7-b2b6-4afa55847985 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:44.103366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-328c1dd5-aec4-4bf7-b2b6-4afa55847985 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:44.103819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-328c1dd5-aec4-4bf7-b2b6-4afa55847985 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:44.104593 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-328c1dd5-aec4-4bf7-b2b6-4afa55847985 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:44.105033 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-328c1dd5-aec4-4bf7-b2b6-4afa55847985 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:44.134497 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-328c1dd5-aec4-4bf7-b2b6-4afa55847985 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043455 May 11 07:42:44.134977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 253/507] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:42:44 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 07:42:44.206782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-1ab2a993-6a84-4076-a139-bd411327ac72 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:44.207339 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-1ab2a993-6a84-4076-a139-bd411327ac72 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:44.213590 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1ab2a993-6a84-4076-a139-bd411327ac72 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:44.214041 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1ab2a993-6a84-4076-a139-bd411327ac72 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:44.214840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1ab2a993-6a84-4076-a139-bd411327ac72 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:44.215276 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1ab2a993-6a84-4076-a139-bd411327ac72 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:44.246526 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-1ab2a993-6a84-4076-a139-bd411327ac72 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Going to try to terminate instance {{(pid=123599) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:42:44.323933 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-1ab2a993-6a84-4076-a139-bd411327ac72 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 204 len: 0 microversion: 2.1 time: 0.120733 May 11 07:42:44.324522 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 255/508] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:42:44 2022] DELETE /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:42:44.333046 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d60fb697-602c-4779-b4dd-004645990a8c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:44.333687 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d60fb697-602c-4779-b4dd-004645990a8c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:44.339542 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d60fb697-602c-4779-b4dd-004645990a8c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:44.339998 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d60fb697-602c-4779-b4dd-004645990a8c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:44.340777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d60fb697-602c-4779-b4dd-004645990a8c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:44.341225 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d60fb697-602c-4779-b4dd-004645990a8c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:44.457320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-e725c30b-f73d-4da3-9065-c526d5f5d084 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:44.458147 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-e725c30b-f73d-4da3-9065-c526d5f5d084 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:44.465188 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e725c30b-f73d-4da3-9065-c526d5f5d084 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:44.465897 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e725c30b-f73d-4da3-9065-c526d5f5d084 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:44.466694 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e725c30b-f73d-4da3-9065-c526d5f5d084 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:44.467136 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e725c30b-f73d-4da3-9065-c526d5f5d084 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:44.471983 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d60fb697-602c-4779-b4dd-004645990a8c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:44.483381 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d60fb697-602c-4779-b4dd-004645990a8c tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1691 microversion: 2.1 time: 0.153563 May 11 07:42:44.483957 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 254/509] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:44 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:44.612614 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-3929c51a-b38a-4705-b31e-9743d210eeff req-1f77742f-945f-42eb-9a05-7bdf6f62bb73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5d5c60-3790-4889-92a4-0bd325a22b43", "tag": "2986b04c-bb85-422f-a436-abb58852a5fc"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:44.614328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-e725c30b-f73d-4da3-9065-c526d5f5d084 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:44.623120 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-e725c30b-f73d-4da3-9065-c526d5f5d084 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:44.625247 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-e725c30b-f73d-4da3-9065-c526d5f5d084 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:44.629726 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-3929c51a-b38a-4705-b31e-9743d210eeff req-1f77742f-945f-42eb-9a05-7bdf6f62bb73 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:44.630170 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-3929c51a-b38a-4705-b31e-9743d210eeff req-1f77742f-945f-42eb-9a05-7bdf6f62bb73 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:44.631591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-e725c30b-f73d-4da3-9065-c526d5f5d084 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1406 microversion: 2.20 time: 0.178832 May 11 07:42:44.632174 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 256/510] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:44 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:44.644382 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-3929c51a-b38a-4705-b31e-9743d210eeff req-1f77742f-945f-42eb-9a05-7bdf6f62bb73 service nova] Creating event network-changed:2986b04c-bb85-422f-a436-abb58852a5fc for instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 on hv-cinder-83699 May 11 07:42:44.650066 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-3929c51a-b38a-4705-b31e-9743d210eeff req-1f77742f-945f-42eb-9a05-7bdf6f62bb73 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040673 May 11 07:42:44.650819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 255/511] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:42:45.500749 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-1d54cd29-c49f-4e1d-9c98-5a879e11aca0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:45.501353 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-1d54cd29-c49f-4e1d-9c98-5a879e11aca0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:45.518382 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1d54cd29-c49f-4e1d-9c98-5a879e11aca0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:45.518382 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1d54cd29-c49f-4e1d-9c98-5a879e11aca0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:45.518382 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1d54cd29-c49f-4e1d-9c98-5a879e11aca0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:45.518382 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1d54cd29-c49f-4e1d-9c98-5a879e11aca0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:45.524705 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-989389c3-341e-4c5a-afd4-c1710b70ab4d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2033099877"}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:45.525441 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-989389c3-341e-4c5a-afd4-c1710b70ab4d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:45.533056 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-989389c3-341e-4c5a-afd4-c1710b70ab4d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:45.533621 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-989389c3-341e-4c5a-afd4-c1710b70ab4d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:45.534523 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-989389c3-341e-4c5a-afd4-c1710b70ab4d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:45.534927 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-989389c3-341e-4c5a-afd4-c1710b70ab4d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:45.730003 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-1d54cd29-c49f-4e1d-9c98-5a879e11aca0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:45.738411 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-1d54cd29-c49f-4e1d-9c98-5a879e11aca0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1691 microversion: 2.1 time: 0.242086 May 11 07:42:45.738985 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 257/512] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:45 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1691 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:45.744640 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-13bf2eab-4d6f-4013-846e-fb1ff54ecf55 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:45.744768 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.network.security_group_api [None req-989389c3-341e-4c5a-afd4-c1710b70ab4d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Adding security group b26c7b67-563f-44f3-bb13-d8765d1c9aa9 to port 2986b04c-bb85-422f-a436-abb58852a5fc May 11 07:42:45.745497 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-13bf2eab-4d6f-4013-846e-fb1ff54ecf55 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:45.753416 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-13bf2eab-4d6f-4013-846e-fb1ff54ecf55 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:45.753911 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-13bf2eab-4d6f-4013-846e-fb1ff54ecf55 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:45.754697 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-13bf2eab-4d6f-4013-846e-fb1ff54ecf55 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:45.755138 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-13bf2eab-4d6f-4013-846e-fb1ff54ecf55 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:45.965956 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-13bf2eab-4d6f-4013-846e-fb1ff54ecf55 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:45.974372 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-13bf2eab-4d6f-4013-846e-fb1ff54ecf55 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:45.975919 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-13bf2eab-4d6f-4013-846e-fb1ff54ecf55 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:45.977054 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-13bf2eab-4d6f-4013-846e-fb1ff54ecf55 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1406 microversion: 2.20 time: 0.236992 May 11 07:42:45.977691 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 258/513] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:45 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:46.211749 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-989389c3-341e-4c5a-afd4-c1710b70ab4d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "POST /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/action" status: 202 len: 0 microversion: 2.1 time: 0.691670 May 11 07:42:46.212353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 256/514] 10.222.0.36 () {60 vars in 1277 bytes} [Wed May 11 07:42:45 2022] POST /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/action => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 07:42:46.221137 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-e4e56e64-080d-4f6b-9b41-3eff394e8d98 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:46.222000 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-e4e56e64-080d-4f6b-9b41-3eff394e8d98 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:46.229570 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-f82c542c-3d92-4e77-8017-e2638a221d5b req-25b1bd3c-140d-404c-9fbf-65de1ae4ebe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5d5c60-3790-4889-92a4-0bd325a22b43", "tag": "2986b04c-bb85-422f-a436-abb58852a5fc"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:46.241172 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-f82c542c-3d92-4e77-8017-e2638a221d5b req-25b1bd3c-140d-404c-9fbf-65de1ae4ebe4 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:46.241645 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-f82c542c-3d92-4e77-8017-e2638a221d5b req-25b1bd3c-140d-404c-9fbf-65de1ae4ebe4 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:46.245884 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e4e56e64-080d-4f6b-9b41-3eff394e8d98 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:46.246443 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e4e56e64-080d-4f6b-9b41-3eff394e8d98 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:46.247425 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e4e56e64-080d-4f6b-9b41-3eff394e8d98 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:46.248028 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e4e56e64-080d-4f6b-9b41-3eff394e8d98 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:46.277066 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-f82c542c-3d92-4e77-8017-e2638a221d5b req-25b1bd3c-140d-404c-9fbf-65de1ae4ebe4 service nova] Creating event network-changed:2986b04c-bb85-422f-a436-abb58852a5fc for instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 on hv-cinder-83699 May 11 07:42:46.282717 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-f82c542c-3d92-4e77-8017-e2638a221d5b req-25b1bd3c-140d-404c-9fbf-65de1ae4ebe4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057009 May 11 07:42:46.284942 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 257/515] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:42:46.428351 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-e4e56e64-080d-4f6b-9b41-3eff394e8d98 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:46.436899 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-e4e56e64-080d-4f6b-9b41-3eff394e8d98 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1643 microversion: 2.1 time: 0.220168 May 11 07:42:46.437834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 259/516] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:46 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1643 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:46.756514 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ec2d85d6-53f9-4af0-ad94-c3c4190fd0a0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:46.757125 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-ec2d85d6-53f9-4af0-ad94-c3c4190fd0a0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:46.763274 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ec2d85d6-53f9-4af0-ad94-c3c4190fd0a0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:46.763718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ec2d85d6-53f9-4af0-ad94-c3c4190fd0a0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:46.764974 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ec2d85d6-53f9-4af0-ad94-c3c4190fd0a0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:46.765406 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ec2d85d6-53f9-4af0-ad94-c3c4190fd0a0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:46.892446 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-ec2d85d6-53f9-4af0-ad94-c3c4190fd0a0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:46.899844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-ec2d85d6-53f9-4af0-ad94-c3c4190fd0a0 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1691 microversion: 2.1 time: 0.148094 May 11 07:42:46.900404 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 258/517] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:46 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:46.995061 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-bd3a8ea2-c226-425d-9f28-a0acae8e589a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:46.995657 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-bd3a8ea2-c226-425d-9f28-a0acae8e589a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:47.002746 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bd3a8ea2-c226-425d-9f28-a0acae8e589a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:47.003195 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bd3a8ea2-c226-425d-9f28-a0acae8e589a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:47.003959 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bd3a8ea2-c226-425d-9f28-a0acae8e589a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:47.004396 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bd3a8ea2-c226-425d-9f28-a0acae8e589a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:47.127560 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-bd3a8ea2-c226-425d-9f28-a0acae8e589a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:47.135238 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-bd3a8ea2-c226-425d-9f28-a0acae8e589a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:47.136736 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-bd3a8ea2-c226-425d-9f28-a0acae8e589a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:47.137854 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-bd3a8ea2-c226-425d-9f28-a0acae8e589a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1406 microversion: 2.20 time: 0.146740 May 11 07:42:47.138416 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 260/518] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:46 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:47.917311 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5012c597-0806-46af-acb4-a9384093a413 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:47.917941 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-5012c597-0806-46af-acb4-a9384093a413 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:47.924612 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5012c597-0806-46af-acb4-a9384093a413 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:47.925058 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5012c597-0806-46af-acb4-a9384093a413 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:47.925846 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5012c597-0806-46af-acb4-a9384093a413 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:47.926286 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5012c597-0806-46af-acb4-a9384093a413 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:48.058770 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-5012c597-0806-46af-acb4-a9384093a413 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:48.066275 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-5012c597-0806-46af-acb4-a9384093a413 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1691 microversion: 2.1 time: 0.152544 May 11 07:42:48.066838 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 259/519] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:47 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:48.155348 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0dddfd69-8986-44de-bc95-d1bdf1fad8bd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:48.155951 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0dddfd69-8986-44de-bc95-d1bdf1fad8bd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:48.162307 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0dddfd69-8986-44de-bc95-d1bdf1fad8bd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:48.163079 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0dddfd69-8986-44de-bc95-d1bdf1fad8bd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:48.163746 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0dddfd69-8986-44de-bc95-d1bdf1fad8bd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:48.164343 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0dddfd69-8986-44de-bc95-d1bdf1fad8bd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:48.297078 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0dddfd69-8986-44de-bc95-d1bdf1fad8bd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:48.304759 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0dddfd69-8986-44de-bc95-d1bdf1fad8bd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:48.306295 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0dddfd69-8986-44de-bc95-d1bdf1fad8bd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:48.307478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0dddfd69-8986-44de-bc95-d1bdf1fad8bd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1599 microversion: 2.20 time: 0.156653 May 11 07:42:48.308043 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 261/520] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:42:48 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:42:48.324632 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-cf71134a-c43f-4533-ad2e-a482192bd3b8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:48.325127 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-cf71134a-c43f-4533-ad2e-a482192bd3b8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:48.331505 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cf71134a-c43f-4533-ad2e-a482192bd3b8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:48.331959 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cf71134a-c43f-4533-ad2e-a482192bd3b8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:48.332725 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cf71134a-c43f-4533-ad2e-a482192bd3b8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:48.333168 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cf71134a-c43f-4533-ad2e-a482192bd3b8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:48.406932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-cf71134a-c43f-4533-ad2e-a482192bd3b8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.086126 May 11 07:42:48.407533 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 260/521] 10.222.0.36 () {60 vars in 1315 bytes} [Wed May 11 07:42:48 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7/os-interface => generated 285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:42:49.083027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-48b5e76f-09a7-41a0-9ede-67de5077d7f7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:49.083855 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-48b5e76f-09a7-41a0-9ede-67de5077d7f7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:49.089913 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-48b5e76f-09a7-41a0-9ede-67de5077d7f7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:49.090440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-48b5e76f-09a7-41a0-9ede-67de5077d7f7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:49.091285 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-48b5e76f-09a7-41a0-9ede-67de5077d7f7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:49.091960 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-48b5e76f-09a7-41a0-9ede-67de5077d7f7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:49.504189 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-4fbcd0db-03e5-4396-87d7-3d0f8b24d9ac req-ffda9032-1c57-4900-8137-4580db675cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0b775a5-13c2-4d45-8015-d7a37683cfb1", "name": "network-vif-deleted", "tag": "91543a14-0ae8-44e1-bba8-2b3a746fbae8"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:49.516345 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-4fbcd0db-03e5-4396-87d7-3d0f8b24d9ac req-ffda9032-1c57-4900-8137-4580db675cab service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:49.517190 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-4fbcd0db-03e5-4396-87d7-3d0f8b24d9ac req-ffda9032-1c57-4900-8137-4580db675cab service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:49.532901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-4fbcd0db-03e5-4396-87d7-3d0f8b24d9ac req-ffda9032-1c57-4900-8137-4580db675cab service nova] Creating event network-vif-deleted:91543a14-0ae8-44e1-bba8-2b3a746fbae8 for instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 on hv-cinder-83699 May 11 07:42:49.544732 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-4fbcd0db-03e5-4396-87d7-3d0f8b24d9ac req-ffda9032-1c57-4900-8137-4580db675cab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045911 May 11 07:42:49.548741 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 261/522] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:42:49.668951 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-48b5e76f-09a7-41a0-9ede-67de5077d7f7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:49.682528 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-48b5e76f-09a7-41a0-9ede-67de5077d7f7 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 200 len: 1691 microversion: 2.1 time: 0.603548 May 11 07:42:49.686319 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 262/523] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:49 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 1691 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:50.103748 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-2bcaa942-b593-46e5-ae3b-bfa9a98a3df4 req-9e983d0c-3871-4684-b65d-450f867298b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03c4e26-68ab-49e2-ac51-aa3bce79d3e7", "tag": "c341b877-b342-4956-94f6-3c4bcad3497f"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:50.111981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-2bcaa942-b593-46e5-ae3b-bfa9a98a3df4 req-9e983d0c-3871-4684-b65d-450f867298b9 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:50.112703 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-2bcaa942-b593-46e5-ae3b-bfa9a98a3df4 req-9e983d0c-3871-4684-b65d-450f867298b9 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:50.124611 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-2bcaa942-b593-46e5-ae3b-bfa9a98a3df4 req-9e983d0c-3871-4684-b65d-450f867298b9 service nova] Creating event network-changed:c341b877-b342-4956-94f6-3c4bcad3497f for instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 on hv-cinder-83699 May 11 07:42:50.129990 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-2bcaa942-b593-46e5-ae3b-bfa9a98a3df4 req-9e983d0c-3871-4684-b65d-450f867298b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030844 May 11 07:42:50.131379 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 262/524] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:42:50.701673 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3703cf32-c675-4d11-b8e0-c45be9206aba tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:50.702375 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-3703cf32-c675-4d11-b8e0-c45be9206aba tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: a0b775a5-13c2-4d45-8015-d7a37683cfb1] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:50.712754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3703cf32-c675-4d11-b8e0-c45be9206aba tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:50.724376 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3703cf32-c675-4d11-b8e0-c45be9206aba tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:50.727151 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3703cf32-c675-4d11-b8e0-c45be9206aba tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:50.731106 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3703cf32-c675-4d11-b8e0-c45be9206aba tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:50.749788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-3703cf32-c675-4d11-b8e0-c45be9206aba tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] HTTP exception thrown: Instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 could not be found. May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3703cf32-c675-4d11-b8e0-c45be9206aba tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Request method failure captured: May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 HTTP/1.1 May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2f4-oKoOE9FBE_RG9FyTwLAv71Px09UBPVP8kenpsEj9SvNzuf6dLSpds-XnOcgdDSjVYNcNr-a5d9Do_2WrjGr2ab1y3lCX6jNf_ktVP1a30PDbGS6tB9iHuA2uLFyNLZOALi5jjB7EvTJ0KtAwD21SpqDnA9bNus1EZRpHIAcMbE May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 5100c1cfe7f148058734c0da2d1497d4 May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:42:50.752506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:42:50.754155 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5100c1cfe7f148058734c0da2d1497d4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5100c1cfe7f148058734c0da2d1497d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5100c1cfe7f148058734c0da2d1497d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5100c1cfe7f148058734c0da2d1497d4"}]}] May 11 07:42:50.754155 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:42:50.754155 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 5100c1cfe7f148058734c0da2d1497d4 May 11 07:42:50.754155 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:42:50.754155 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-ServerRescueNegativeTestJSON-280701147-project May 11 07:42:50.754155 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:42:50.754155 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:42:50.754155 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: cb70f7eb7b44487a9ee3f331c83f9e31 May 11 07:42:50.754155 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-ServerRescueNegativeTestJSON-280701147-project May 11 07:42:50.754155 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:42:50.754155 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 could not be found. May 11 07:42:50.754155 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': 'a0b775a5-13c2-4d45-8015-d7a37683cfb1'} May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 could not be found. May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:42:50.755039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 could not be found. May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 could not be found. May 11 07:42:50.756481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:42:50.760892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3703cf32-c675-4d11-b8e0-c45be9206aba tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Returning 404 to user: Instance a0b775a5-13c2-4d45-8015-d7a37683cfb1 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:42:50.762057 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-3703cf32-c675-4d11-b8e0-c45be9206aba tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1" status: 404 len: 111 microversion: 2.1 time: 0.065282 May 11 07:42:50.763144 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 263/525] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:50 2022] GET /compute/v2.1/servers/a0b775a5-13c2-4d45-8015-d7a37683cfb1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:42:50.773251 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-fbe9b185-8ad2-4f51-95a6-75d6420b7f83 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '.version_select at 0x7f19ed1ca700>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:50.797461 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-fbe9b185-8ad2-4f51-95a6-75d6420b7f83 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725013394" status: 202 len: 0 microversion: 2.1 time: 0.028885 May 11 07:42:50.802228 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 263/526] 10.222.0.36 () {58 vars in 1220 bytes} [Wed May 11 07:42:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725013394 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:42:53.715769 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-401d1858-0b81-4dab-b5f4-bb8d203430cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:53.716310 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-401d1858-0b81-4dab-b5f4-bb8d203430cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:53.723222 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-401d1858-0b81-4dab-b5f4-bb8d203430cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:53.723668 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-401d1858-0b81-4dab-b5f4-bb8d203430cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:53.724422 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-401d1858-0b81-4dab-b5f4-bb8d203430cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:53.724855 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-401d1858-0b81-4dab-b5f4-bb8d203430cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:53.749869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-401d1858-0b81-4dab-b5f4-bb8d203430cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Going to try to terminate instance {{(pid=123599) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:42:53.823259 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-401d1858-0b81-4dab-b5f4-bb8d203430cf tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 204 len: 0 microversion: 2.1 time: 0.110853 May 11 07:42:53.823924 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 264/527] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:42:53 2022] DELETE /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:42:53.833662 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7e76324e-099e-489c-a374-1d53197c4c28 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:53.834401 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7e76324e-099e-489c-a374-1d53197c4c28 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:53.841592 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7e76324e-099e-489c-a374-1d53197c4c28 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:53.842054 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7e76324e-099e-489c-a374-1d53197c4c28 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:53.842904 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7e76324e-099e-489c-a374-1d53197c4c28 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:53.843627 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7e76324e-099e-489c-a374-1d53197c4c28 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:53.978961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7e76324e-099e-489c-a374-1d53197c4c28 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:53.986471 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7e76324e-099e-489c-a374-1d53197c4c28 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1508 microversion: 2.1 time: 0.157376 May 11 07:42:53.987037 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 264/528] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:53 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:55.003836 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-e9b7f308-ebce-4f67-916f-b635386dd6e6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:55.004549 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-e9b7f308-ebce-4f67-916f-b635386dd6e6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:55.010825 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e9b7f308-ebce-4f67-916f-b635386dd6e6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:55.011267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e9b7f308-ebce-4f67-916f-b635386dd6e6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:55.012017 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e9b7f308-ebce-4f67-916f-b635386dd6e6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:55.012445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e9b7f308-ebce-4f67-916f-b635386dd6e6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:55.138208 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-e9b7f308-ebce-4f67-916f-b635386dd6e6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:55.145368 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-e9b7f308-ebce-4f67-916f-b635386dd6e6 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1508 microversion: 2.1 time: 0.145766 May 11 07:42:55.145952 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 265/529] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:54 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:56.162082 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-0c3fbe0a-85b3-4f54-a26a-5d8b95dab8dc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:56.162695 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-0c3fbe0a-85b3-4f54-a26a-5d8b95dab8dc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:56.168984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0c3fbe0a-85b3-4f54-a26a-5d8b95dab8dc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:56.169437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0c3fbe0a-85b3-4f54-a26a-5d8b95dab8dc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:56.170270 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0c3fbe0a-85b3-4f54-a26a-5d8b95dab8dc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:56.170712 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0c3fbe0a-85b3-4f54-a26a-5d8b95dab8dc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:56.298813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0c3fbe0a-85b3-4f54-a26a-5d8b95dab8dc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:56.306185 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-0c3fbe0a-85b3-4f54-a26a-5d8b95dab8dc tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 200 len: 1508 microversion: 2.1 time: 0.147888 May 11 07:42:56.306749 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 265/530] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:56 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:56.694575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-c77466be-f0b7-4a1c-9b6a-f3db86abc3ad req-e4a1b52f-0850-44b6-83a9-691348562a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a9a7c6d-2396-446b-9d87-3a9fb36d031c", "name": "network-vif-deleted", "tag": "aa4cf226-9012-4577-8ddd-7b9559ce1960"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:42:56.709698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-c77466be-f0b7-4a1c-9b6a-f3db86abc3ad req-e4a1b52f-0850-44b6-83a9-691348562a77 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:56.710399 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-c77466be-f0b7-4a1c-9b6a-f3db86abc3ad req-e4a1b52f-0850-44b6-83a9-691348562a77 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:56.723938 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-c77466be-f0b7-4a1c-9b6a-f3db86abc3ad req-e4a1b52f-0850-44b6-83a9-691348562a77 service nova] Creating event network-vif-deleted:aa4cf226-9012-4577-8ddd-7b9559ce1960 for instance 7a9a7c6d-2396-446b-9d87-3a9fb36d031c on hv-cinder-83699 May 11 07:42:56.729044 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-c77466be-f0b7-4a1c-9b6a-f3db86abc3ad req-e4a1b52f-0850-44b6-83a9-691348562a77 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038151 May 11 07:42:56.730289 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 266/531] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:42:57.322855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5ef05bb6-26a6-4dda-b194-9f828d7ce03f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:57.323468 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-5ef05bb6-26a6-4dda-b194-9f828d7ce03f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 7a9a7c6d-2396-446b-9d87-3a9fb36d031c] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:57.329767 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5ef05bb6-26a6-4dda-b194-9f828d7ce03f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:57.330224 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5ef05bb6-26a6-4dda-b194-9f828d7ce03f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:57.330991 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5ef05bb6-26a6-4dda-b194-9f828d7ce03f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:57.331430 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5ef05bb6-26a6-4dda-b194-9f828d7ce03f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:57.344312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-5ef05bb6-26a6-4dda-b194-9f828d7ce03f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] HTTP exception thrown: Instance 7a9a7c6d-2396-446b-9d87-3a9fb36d031c could not be found. May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5ef05bb6-26a6-4dda-b194-9f828d7ce03f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Request method failure captured: May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c HTTP/1.1 May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2f4-oKoOE9FBE_RG9FyTwLAv71Px09UBPVP8kenpsEj9SvNzuf6dLSpds-XnOcgdDSjVYNcNr-a5d9Do_2WrjGr2ab1y3lCX6jNf_ktVP1a30PDbGS6tB9iHuA2uLFyNLZOALi5jjB7EvTJ0KtAwD21SpqDnA9bNus1EZRpHIAcMbE May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 5100c1cfe7f148058734c0da2d1497d4 May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:42:57.345937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:42:57.347387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5100c1cfe7f148058734c0da2d1497d4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5100c1cfe7f148058734c0da2d1497d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5100c1cfe7f148058734c0da2d1497d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5100c1cfe7f148058734c0da2d1497d4"}]}] May 11 07:42:57.347387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:42:57.347387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 5100c1cfe7f148058734c0da2d1497d4 May 11 07:42:57.347387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:42:57.347387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-ServerRescueNegativeTestJSON-280701147-project May 11 07:42:57.347387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:42:57.347387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:42:57.347387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: cb70f7eb7b44487a9ee3f331c83f9e31 May 11 07:42:57.347387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-ServerRescueNegativeTestJSON-280701147-project May 11 07:42:57.347387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:42:57.347387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 7a9a7c6d-2396-446b-9d87-3a9fb36d031c could not be found. May 11 07:42:57.347387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '7a9a7c6d-2396-446b-9d87-3a9fb36d031c'} May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a9a7c6d-2396-446b-9d87-3a9fb36d031c could not be found. May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:42:57.348319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a9a7c6d-2396-446b-9d87-3a9fb36d031c could not be found. May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a9a7c6d-2396-446b-9d87-3a9fb36d031c could not be found. May 11 07:42:57.349718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:42:57.351068 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5ef05bb6-26a6-4dda-b194-9f828d7ce03f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Returning 404 to user: Instance 7a9a7c6d-2396-446b-9d87-3a9fb36d031c could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:42:57.351068 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-5ef05bb6-26a6-4dda-b194-9f828d7ce03f tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c" status: 404 len: 111 microversion: 2.1 time: 0.028327 May 11 07:42:57.351068 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 266/532] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:57 2022] GET /compute/v2.1/servers/7a9a7c6d-2396-446b-9d87-3a9fb36d031c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:42:57.356076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-247589f7-c914-47e9-b36a-63438f34fa77 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:57.356654 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-247589f7-c914-47e9-b36a-63438f34fa77 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:57.363165 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-247589f7-c914-47e9-b36a-63438f34fa77 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:57.363606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-247589f7-c914-47e9-b36a-63438f34fa77 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:57.364361 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-247589f7-c914-47e9-b36a-63438f34fa77 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:57.364794 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-247589f7-c914-47e9-b36a-63438f34fa77 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:57.388925 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-247589f7-c914-47e9-b36a-63438f34fa77 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Going to try to terminate instance {{(pid=123599) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:42:57.460578 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-247589f7-c914-47e9-b36a-63438f34fa77 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "DELETE /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 204 len: 0 microversion: 2.1 time: 0.108330 May 11 07:42:57.461170 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 267/533] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:42:57 2022] DELETE /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:42:57.470127 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d46c5a3f-b657-42f2-9f02-868288f5a4af tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:57.470742 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d46c5a3f-b657-42f2-9f02-868288f5a4af tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:57.476882 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d46c5a3f-b657-42f2-9f02-868288f5a4af tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:57.477336 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d46c5a3f-b657-42f2-9f02-868288f5a4af tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:57.478138 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d46c5a3f-b657-42f2-9f02-868288f5a4af tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:57.478578 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d46c5a3f-b657-42f2-9f02-868288f5a4af tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:57.609547 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d46c5a3f-b657-42f2-9f02-868288f5a4af tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:57.616666 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d46c5a3f-b657-42f2-9f02-868288f5a4af tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.151399 May 11 07:42:57.617217 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 267/534] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:57 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:58.634045 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-f12a5261-83f7-4f73-bef6-6e01c1d68020 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:58.634664 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-f12a5261-83f7-4f73-bef6-6e01c1d68020 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:58.640959 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f12a5261-83f7-4f73-bef6-6e01c1d68020 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:58.641404 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f12a5261-83f7-4f73-bef6-6e01c1d68020 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:58.642193 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f12a5261-83f7-4f73-bef6-6e01c1d68020 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:58.642629 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f12a5261-83f7-4f73-bef6-6e01c1d68020 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:58.769337 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-f12a5261-83f7-4f73-bef6-6e01c1d68020 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:58.776514 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-f12a5261-83f7-4f73-bef6-6e01c1d68020 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.146715 May 11 07:42:58.777120 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 268/535] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:58 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:42:59.792296 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2a25e594-00d8-4db4-9f04-8e758ca27148 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:42:59.792906 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2a25e594-00d8-4db4-9f04-8e758ca27148 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:42:59.799212 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2a25e594-00d8-4db4-9f04-8e758ca27148 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:59.799664 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2a25e594-00d8-4db4-9f04-8e758ca27148 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:59.800426 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2a25e594-00d8-4db4-9f04-8e758ca27148 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:42:59.800867 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2a25e594-00d8-4db4-9f04-8e758ca27148 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:42:59.926804 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-2a25e594-00d8-4db4-9f04-8e758ca27148 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:42:59.934009 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2a25e594-00d8-4db4-9f04-8e758ca27148 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.145535 May 11 07:42:59.934565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 268/536] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:42:59 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:00.952759 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-891dbeff-d715-46f9-8eeb-0ebb43b8a10b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:00.953291 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-891dbeff-d715-46f9-8eeb-0ebb43b8a10b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:00.961182 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-891dbeff-d715-46f9-8eeb-0ebb43b8a10b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:00.962019 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-891dbeff-d715-46f9-8eeb-0ebb43b8a10b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:00.962914 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-891dbeff-d715-46f9-8eeb-0ebb43b8a10b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:00.964757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-891dbeff-d715-46f9-8eeb-0ebb43b8a10b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:01.099317 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-891dbeff-d715-46f9-8eeb-0ebb43b8a10b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb70f7eb7b44487a9ee3f331c83f9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5100c1cfe7f148058734c0da2d1497d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:01.106728 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-891dbeff-d715-46f9-8eeb-0ebb43b8a10b tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 200 len: 1521 microversion: 2.1 time: 0.158445 May 11 07:43:01.107331 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 269/537] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:00 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:01.514651 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-72b4e220-a64a-4afd-8dfa-08f98a38e744 req-94fa2131-9024-4e3d-a68f-37a4c4f966d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40960ef3-1318-49f6-9a5e-c5b12205f0f6", "name": "network-vif-deleted", "tag": "be1479b9-6c95-4550-bed0-2553312bf4f3"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:01.524938 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-72b4e220-a64a-4afd-8dfa-08f98a38e744 req-94fa2131-9024-4e3d-a68f-37a4c4f966d4 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:01.525396 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-72b4e220-a64a-4afd-8dfa-08f98a38e744 req-94fa2131-9024-4e3d-a68f-37a4c4f966d4 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:01.537030 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-72b4e220-a64a-4afd-8dfa-08f98a38e744 req-94fa2131-9024-4e3d-a68f-37a4c4f966d4 service nova] Creating event network-vif-deleted:be1479b9-6c95-4550-bed0-2553312bf4f3 for instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 on hv-cinder-83699 May 11 07:43:01.542719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-72b4e220-a64a-4afd-8dfa-08f98a38e744 req-94fa2131-9024-4e3d-a68f-37a4c4f966d4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032522 May 11 07:43:01.543330 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 269/538] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:43:02.123648 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-8209834b-f168-451e-8536-6bb42e57f5c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:02.124201 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-8209834b-f168-451e-8536-6bb42e57f5c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] [instance: 40960ef3-1318-49f6-9a5e-c5b12205f0f6] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:02.130479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8209834b-f168-451e-8536-6bb42e57f5c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:02.130925 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8209834b-f168-451e-8536-6bb42e57f5c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:02.131679 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8209834b-f168-451e-8536-6bb42e57f5c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:02.132108 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8209834b-f168-451e-8536-6bb42e57f5c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:02.145168 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-8209834b-f168-451e-8536-6bb42e57f5c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] HTTP exception thrown: Instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 could not be found. May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-8209834b-f168-451e-8536-6bb42e57f5c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Request method failure captured: May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 HTTP/1.1 May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2f4-oKoOE9FBE_RG9FyTwLAv71Px09UBPVP8kenpsEj9SvNzuf6dLSpds-XnOcgdDSjVYNcNr-a5d9Do_2WrjGr2ab1y3lCX6jNf_ktVP1a30PDbGS6tB9iHuA2uLFyNLZOALi5jjB7EvTJ0KtAwD21SpqDnA9bNus1EZRpHIAcMbE May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 5100c1cfe7f148058734c0da2d1497d4 May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:43:02.146796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:43:02.148287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5100c1cfe7f148058734c0da2d1497d4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5100c1cfe7f148058734c0da2d1497d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5100c1cfe7f148058734c0da2d1497d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5100c1cfe7f148058734c0da2d1497d4"}]}] May 11 07:43:02.148287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:43:02.148287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 5100c1cfe7f148058734c0da2d1497d4 May 11 07:43:02.148287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-280701147 May 11 07:43:02.148287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-ServerRescueNegativeTestJSON-280701147-project May 11 07:43:02.148287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:43:02.148287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:43:02.148287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: cb70f7eb7b44487a9ee3f331c83f9e31 May 11 07:43:02.148287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-ServerRescueNegativeTestJSON-280701147-project May 11 07:43:02.148287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:43:02.148287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 could not be found. May 11 07:43:02.148287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '40960ef3-1318-49f6-9a5e-c5b12205f0f6'} May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 could not be found. May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:43:02.149076 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 could not be found. May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 could not be found. May 11 07:43:02.150263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:43:02.151302 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-8209834b-f168-451e-8536-6bb42e57f5c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] Returning 404 to user: Instance 40960ef3-1318-49f6-9a5e-c5b12205f0f6 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:43:02.151302 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-8209834b-f168-451e-8536-6bb42e57f5c5 tempest-ServerRescueNegativeTestJSON-280701147 tempest-ServerRescueNegativeTestJSON-280701147-project] 10.222.0.36 "GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6" status: 404 len: 111 microversion: 2.1 time: 0.028526 May 11 07:43:02.151302 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 270/539] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:02 2022] GET /compute/v2.1/servers/40960ef3-1318-49f6-9a5e-c5b12205f0f6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:43:04.135278 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-aebad1b3-28c2-4ad8-aadb-d617dc265b8d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:04.136284 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-aebad1b3-28c2-4ad8-aadb-d617dc265b8d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:04.143554 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aebad1b3-28c2-4ad8-aadb-d617dc265b8d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:04.144004 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aebad1b3-28c2-4ad8-aadb-d617dc265b8d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:04.144778 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aebad1b3-28c2-4ad8-aadb-d617dc265b8d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:04.145211 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aebad1b3-28c2-4ad8-aadb-d617dc265b8d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:04.174864 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-aebad1b3-28c2-4ad8-aadb-d617dc265b8d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043773 May 11 07:43:04.175420 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 270/540] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:43:04 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 07:43:04.236152 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-8419c968-2b88-4687-b8bd-8b7a67c836ac tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:04.236691 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-8419c968-2b88-4687-b8bd-8b7a67c836ac tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:04.242586 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8419c968-2b88-4687-b8bd-8b7a67c836ac tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:04.243224 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8419c968-2b88-4687-b8bd-8b7a67c836ac tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:04.244002 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8419c968-2b88-4687-b8bd-8b7a67c836ac tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:04.244443 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8419c968-2b88-4687-b8bd-8b7a67c836ac tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:04.272928 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-8419c968-2b88-4687-b8bd-8b7a67c836ac tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Going to try to terminate instance {{(pid=123599) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:43:04.358751 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-8419c968-2b88-4687-b8bd-8b7a67c836ac tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 204 len: 0 microversion: 2.1 time: 0.125923 May 11 07:43:04.359912 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 271/541] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:43:04 2022] DELETE /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:43:04.368529 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-534a3427-a98c-4140-b3b3-f0890ae41388 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:04.369392 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-534a3427-a98c-4140-b3b3-f0890ae41388 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:04.375851 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-534a3427-a98c-4140-b3b3-f0890ae41388 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:04.376341 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-534a3427-a98c-4140-b3b3-f0890ae41388 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:04.377114 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-534a3427-a98c-4140-b3b3-f0890ae41388 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:04.377572 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-534a3427-a98c-4140-b3b3-f0890ae41388 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:04.664261 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-534a3427-a98c-4140-b3b3-f0890ae41388 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:04.671981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-534a3427-a98c-4140-b3b3-f0890ae41388 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1671 microversion: 2.1 time: 0.307765 May 11 07:43:04.672539 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 271/542] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:04 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1671 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:05.690154 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-91124ed0-ecdf-4d3a-9dc6-4e9e2754d709 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:05.690858 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-91124ed0-ecdf-4d3a-9dc6-4e9e2754d709 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:05.698027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-91124ed0-ecdf-4d3a-9dc6-4e9e2754d709 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:05.698487 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-91124ed0-ecdf-4d3a-9dc6-4e9e2754d709 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:05.699261 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-91124ed0-ecdf-4d3a-9dc6-4e9e2754d709 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:05.699754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-91124ed0-ecdf-4d3a-9dc6-4e9e2754d709 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:05.834553 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-91124ed0-ecdf-4d3a-9dc6-4e9e2754d709 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:05.841973 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-91124ed0-ecdf-4d3a-9dc6-4e9e2754d709 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1671 microversion: 2.1 time: 0.156020 May 11 07:43:05.842540 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 272/543] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:05 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:06.860742 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-892176aa-5373-4755-a19f-034b4da6e2ec tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:06.861398 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-892176aa-5373-4755-a19f-034b4da6e2ec tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:06.868007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-892176aa-5373-4755-a19f-034b4da6e2ec tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:06.868459 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-892176aa-5373-4755-a19f-034b4da6e2ec tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:06.869235 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-892176aa-5373-4755-a19f-034b4da6e2ec tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:06.869710 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-892176aa-5373-4755-a19f-034b4da6e2ec tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:07.008716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-892176aa-5373-4755-a19f-034b4da6e2ec tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:07.016546 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-892176aa-5373-4755-a19f-034b4da6e2ec tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 200 len: 1671 microversion: 2.1 time: 0.160981 May 11 07:43:07.018840 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 272/544] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:06 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:07.425582 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-9c184dc6-9311-406e-a7e7-312e395f7025 req-c0aef6af-e612-4fe9-9834-797eda31d2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e62bda3-ed20-4c7e-a3c8-aa90f6f79937", "name": "network-vif-deleted", "tag": "95cc9cfe-62b1-4c76-8e8f-f82e3b55dada"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:07.434917 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-9c184dc6-9311-406e-a7e7-312e395f7025 req-c0aef6af-e612-4fe9-9834-797eda31d2b9 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:07.435598 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-9c184dc6-9311-406e-a7e7-312e395f7025 req-c0aef6af-e612-4fe9-9834-797eda31d2b9 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:07.447936 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-9c184dc6-9311-406e-a7e7-312e395f7025 req-c0aef6af-e612-4fe9-9834-797eda31d2b9 service nova] Creating event network-vif-deleted:95cc9cfe-62b1-4c76-8e8f-f82e3b55dada for instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 on hv-cinder-83699 May 11 07:43:07.453989 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-9c184dc6-9311-406e-a7e7-312e395f7025 req-c0aef6af-e612-4fe9-9834-797eda31d2b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031499 May 11 07:43:07.454842 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 273/545] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:43:08.035519 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c17ec3dd-c652-4e06-8e28-13338cc5012b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:08.036155 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c17ec3dd-c652-4e06-8e28-13338cc5012b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:08.042760 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c17ec3dd-c652-4e06-8e28-13338cc5012b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:08.043455 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c17ec3dd-c652-4e06-8e28-13338cc5012b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:08.044298 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c17ec3dd-c652-4e06-8e28-13338cc5012b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:08.044743 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c17ec3dd-c652-4e06-8e28-13338cc5012b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:08.058231 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-c17ec3dd-c652-4e06-8e28-13338cc5012b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] HTTP exception thrown: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c17ec3dd-c652-4e06-8e28-13338cc5012b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Request method failure captured: May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 HTTP/1.1 May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2gwcFxlgwT1958No_L1WwQW6zk6fYuQHg_KPUnhySA_8sTYgG9h0IA9XiK5qqPMKtkDNBSXF2-Gd-ZGB_px5NID_-EPdzy81vOG6gmFYh7EMatUVJzYS9LjCwt7sZCBwLlk7DpqCxZLX3hvPBe_DGLrYdmyyUIBEL6Dh4P6N41oyyg May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 9750cb9309234cb1b63343050ba700f9 May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-AttachVolumeTestJSON-1030254869 May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:43:08.060395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:43:08.061962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9750cb9309234cb1b63343050ba700f9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9750cb9309234cb1b63343050ba700f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9750cb9309234cb1b63343050ba700f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9750cb9309234cb1b63343050ba700f9"}]}] May 11 07:43:08.061962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-AttachVolumeTestJSON-1030254869 May 11 07:43:08.061962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 9750cb9309234cb1b63343050ba700f9 May 11 07:43:08.061962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1030254869 May 11 07:43:08.061962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-AttachVolumeTestJSON-1030254869-project May 11 07:43:08.061962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:43:08.061962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:43:08.061962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: ad7271d8e9424bb7ad8ce1143fc71de9 May 11 07:43:08.061962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-AttachVolumeTestJSON-1030254869-project May 11 07:43:08.061962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:43:08.061962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:43:08.061962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '9e62bda3-ed20-4c7e-a3c8-aa90f6f79937'} May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:43:08.062824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:43:08.064105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:43:08.065348 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c17ec3dd-c652-4e06-8e28-13338cc5012b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Returning 404 to user: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:43:08.065348 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c17ec3dd-c652-4e06-8e28-13338cc5012b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 404 len: 111 microversion: 2.1 time: 0.030938 May 11 07:43:08.065348 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 273/546] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:08 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 07:43:08.071968 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-95edd4e1-2f03-4629-8788-1f06389084a8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '.version_select at 0x7f19ec9351f0>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:08.089494 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-95edd4e1-2f03-4629-8788-1f06389084a8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-566401466" status: 202 len: 0 microversion: 2.1 time: 0.021602 May 11 07:43:08.090194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 274/547] 10.222.0.36 () {58 vars in 1217 bytes} [Wed May 11 07:43:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-566401466 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:43:08.742056 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-fad8dfdd-b9c3-4bb3-b0f4-5587e0bf3254 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Action: 'create', calling method: .version_select at 0x7f19ed235d30>, body: {"keypair": {"name": "tempest-keypair-2082201760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWcRtoxW413UZClNbEgTR+zL83OCRZMGNhPq9WSbKnvc/23DQeAGJpmrsE7oRlrvIh4Qkrarwjzn6Lp7pZexLwIAWBjH/ws3yqPONQnbxnJhns6s9Y/B72qzjyrdKwJtw=="}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:08.756881 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-fad8dfdd-b9c3-4bb3-b0f4-5587e0bf3254 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Getting quotas for project 9750cb9309234cb1b63343050ba700f9. Resources: {'key_pairs'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:43:08.760653 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-fad8dfdd-b9c3-4bb3-b0f4-5587e0bf3254 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Getting quotas for user ad7271d8e9424bb7ad8ce1143fc71de9 and project 9750cb9309234cb1b63343050ba700f9. Resources: {'key_pairs'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:43:08.783152 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-fad8dfdd-b9c3-4bb3-b0f4-5587e0bf3254 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045172 May 11 07:43:08.783742 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 274/548] 10.222.0.36 () {60 vars in 1158 bytes} [Wed May 11 07:43:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:43:10.084751 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1460288152", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e16a8a2-6e6f-43bc-8406-954bb2e1bbba"}], "security_groups": [{"name": "tempest-securitygroup--627717013"}], "key_name": "tempest-keypair-2082201760", "user_data": "}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:10.186183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.network.neutron [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] validate_networks() for [('3e16a8a2-6e6f-43bc-8406-954bb2e1bbba', None, None, None, None, None)] {{(pid=123599) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:43:10.547547 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Flavor limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:43:10.547973 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Image limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:43:10.548468 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Flavor pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:43:10.548869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Image pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:43:10.549272 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:43:10.558041 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:10.558487 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:10.559280 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:10.559711 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:10.576717 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Getting quotas for project 9750cb9309234cb1b63343050ba700f9. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:43:10.581568 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Getting quotas for user ad7271d8e9424bb7ad8ce1143fc71de9 and project 9750cb9309234cb1b63343050ba700f9. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:43:10.599205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Going to run 1 instances... {{(pid=123599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:43:10.601725 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:43:10.661449 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0ab9fb02-eae0-43a8-8a46-c6f4c1143523 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.581376 May 11 07:43:10.662412 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 275/549] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:43:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:43:10.673254 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a20128f1-78c6-4f6e-9791-e1136b36cdd3 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:10.674437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a20128f1-78c6-4f6e-9791-e1136b36cdd3 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:10.728765 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a20128f1-78c6-4f6e-9791-e1136b36cdd3 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:10.736268 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a20128f1-78c6-4f6e-9791-e1136b36cdd3 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 200 len: 1238 microversion: 2.1 time: 0.067712 May 11 07:43:10.745362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 275/550] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:10 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:11.753337 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-dfdeedc4-0208-460b-99f4-1bc9083c49d9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:11.753987 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-dfdeedc4-0208-460b-99f4-1bc9083c49d9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:11.763684 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dfdeedc4-0208-460b-99f4-1bc9083c49d9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:11.764322 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dfdeedc4-0208-460b-99f4-1bc9083c49d9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:11.766058 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dfdeedc4-0208-460b-99f4-1bc9083c49d9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:11.766691 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dfdeedc4-0208-460b-99f4-1bc9083c49d9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:11.837637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-dfdeedc4-0208-460b-99f4-1bc9083c49d9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:11.844792 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-dfdeedc4-0208-460b-99f4-1bc9083c49d9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 200 len: 1296 microversion: 2.1 time: 0.095997 May 11 07:43:11.845353 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 276/551] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:11 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 1296 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:12.028899 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-62b11fb9-7413-4ac5-a23a-66c9611648ee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:12.029945 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-62b11fb9-7413-4ac5-a23a-66c9611648ee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:12.035914 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-62b11fb9-7413-4ac5-a23a-66c9611648ee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:12.036395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-62b11fb9-7413-4ac5-a23a-66c9611648ee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:12.037183 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-62b11fb9-7413-4ac5-a23a-66c9611648ee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:12.037677 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-62b11fb9-7413-4ac5-a23a-66c9611648ee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:12.119071 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-62b11fb9-7413-4ac5-a23a-66c9611648ee tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "POST /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/action" status: 202 len: 0 microversion: 2.1 time: 0.094165 May 11 07:43:12.125048 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 276/552] 10.222.0.36 () {60 vars in 1277 bytes} [Wed May 11 07:43:12 2022] POST /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:43:12.129826 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-88bdf4ad-85c3-4f02-badd-5aabb69e08c5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:12.130646 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-88bdf4ad-85c3-4f02-badd-5aabb69e08c5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:12.137067 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-88bdf4ad-85c3-4f02-badd-5aabb69e08c5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:12.137797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-88bdf4ad-85c3-4f02-badd-5aabb69e08c5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:12.138833 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-88bdf4ad-85c3-4f02-badd-5aabb69e08c5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:12.139293 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-88bdf4ad-85c3-4f02-badd-5aabb69e08c5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:12.394690 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-88bdf4ad-85c3-4f02-badd-5aabb69e08c5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:12.403104 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-88bdf4ad-85c3-4f02-badd-5aabb69e08c5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1754 microversion: 2.1 time: 0.277645 May 11 07:43:12.413474 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 277/553] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:12 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1754 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:12.862933 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4221819d-aa5c-4246-bf2b-e493af4641a8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:12.863794 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4221819d-aa5c-4246-bf2b-e493af4641a8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:12.871281 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4221819d-aa5c-4246-bf2b-e493af4641a8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:12.871726 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4221819d-aa5c-4246-bf2b-e493af4641a8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:12.872711 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4221819d-aa5c-4246-bf2b-e493af4641a8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:12.873306 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4221819d-aa5c-4246-bf2b-e493af4641a8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:13.082070 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4221819d-aa5c-4246-bf2b-e493af4641a8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:13.090666 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4221819d-aa5c-4246-bf2b-e493af4641a8 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 200 len: 1363 microversion: 2.1 time: 0.231740 May 11 07:43:13.092111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 277/554] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:12 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:43:13.421006 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a0304439-8739-444d-b8ce-82664e0444be tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:13.421886 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a0304439-8739-444d-b8ce-82664e0444be tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:13.428334 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a0304439-8739-444d-b8ce-82664e0444be tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:13.428838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a0304439-8739-444d-b8ce-82664e0444be tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:13.429914 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a0304439-8739-444d-b8ce-82664e0444be tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:13.430357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a0304439-8739-444d-b8ce-82664e0444be tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:13.519675 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-57fca074-62a7-4789-96ce-4beeadba9512 req-99615149-80a6-4f1d-8018-6cb82f0462f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d19445-31da-4e52-849f-b17774fef588", "tag": "db802acb-b2fb-41d5-ae0d-61aea6391681"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:13.534192 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-57fca074-62a7-4789-96ce-4beeadba9512 req-99615149-80a6-4f1d-8018-6cb82f0462f8 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:13.534646 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-57fca074-62a7-4789-96ce-4beeadba9512 req-99615149-80a6-4f1d-8018-6cb82f0462f8 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:13.560867 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-57fca074-62a7-4789-96ce-4beeadba9512 req-99615149-80a6-4f1d-8018-6cb82f0462f8 service nova] Creating event network-changed:db802acb-b2fb-41d5-ae0d-61aea6391681 for instance 38d19445-31da-4e52-849f-b17774fef588 on hv-cinder-83699 May 11 07:43:13.568420 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-57fca074-62a7-4789-96ce-4beeadba9512 req-99615149-80a6-4f1d-8018-6cb82f0462f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055933 May 11 07:43:13.569034 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 278/555] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:43:13.608089 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a0304439-8739-444d-b8ce-82664e0444be tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:13.620932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a0304439-8739-444d-b8ce-82664e0444be tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1759 microversion: 2.1 time: 0.203804 May 11 07:43:13.621666 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 278/556] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:13 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1759 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:14.110213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7c1ca4ab-4bf9-498f-92ab-fd8d70c34ef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:14.111035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7c1ca4ab-4bf9-498f-92ab-fd8d70c34ef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:14.117185 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7c1ca4ab-4bf9-498f-92ab-fd8d70c34ef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:14.117677 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7c1ca4ab-4bf9-498f-92ab-fd8d70c34ef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:14.118455 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7c1ca4ab-4bf9-498f-92ab-fd8d70c34ef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:14.118891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7c1ca4ab-4bf9-498f-92ab-fd8d70c34ef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:14.277480 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7c1ca4ab-4bf9-498f-92ab-fd8d70c34ef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:14.285322 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7c1ca4ab-4bf9-498f-92ab-fd8d70c34ef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 200 len: 1363 microversion: 2.1 time: 0.180872 May 11 07:43:14.285924 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 279/557] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:14 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:14.643527 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-1c9f9007-8fad-4de4-9e64-461067503a59 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:14.644019 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-1c9f9007-8fad-4de4-9e64-461067503a59 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:14.650215 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1c9f9007-8fad-4de4-9e64-461067503a59 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:14.650668 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1c9f9007-8fad-4de4-9e64-461067503a59 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:14.651468 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1c9f9007-8fad-4de4-9e64-461067503a59 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:14.651903 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1c9f9007-8fad-4de4-9e64-461067503a59 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:14.798623 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-1c9f9007-8fad-4de4-9e64-461067503a59 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:14.806792 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-1c9f9007-8fad-4de4-9e64-461067503a59 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1759 microversion: 2.1 time: 0.167920 May 11 07:43:14.807451 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 279/558] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:14 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:15.302182 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8224569e-b672-4feb-9831-f0b73f1f4d16 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:15.302887 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8224569e-b672-4feb-9831-f0b73f1f4d16 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:15.310868 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8224569e-b672-4feb-9831-f0b73f1f4d16 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:15.311423 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8224569e-b672-4feb-9831-f0b73f1f4d16 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:15.312312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8224569e-b672-4feb-9831-f0b73f1f4d16 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:15.312980 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8224569e-b672-4feb-9831-f0b73f1f4d16 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:15.452349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8224569e-b672-4feb-9831-f0b73f1f4d16 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:15.461585 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8224569e-b672-4feb-9831-f0b73f1f4d16 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 200 len: 1363 microversion: 2.1 time: 0.163306 May 11 07:43:15.462279 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 280/559] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:15 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:15.824429 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-f87183d3-7608-4145-81ce-03f56c3c2dac tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:15.825456 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-f87183d3-7608-4145-81ce-03f56c3c2dac tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:15.831367 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f87183d3-7608-4145-81ce-03f56c3c2dac tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:15.831816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f87183d3-7608-4145-81ce-03f56c3c2dac tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:15.832581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f87183d3-7608-4145-81ce-03f56c3c2dac tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:15.833012 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f87183d3-7608-4145-81ce-03f56c3c2dac tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:15.976162 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-f87183d3-7608-4145-81ce-03f56c3c2dac tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:15.984176 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-f87183d3-7608-4145-81ce-03f56c3c2dac tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1759 microversion: 2.1 time: 0.163651 May 11 07:43:15.984751 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 280/560] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:15 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:16.478574 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-51f222b7-7152-412d-a657-0af371cd766b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:16.479114 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-51f222b7-7152-412d-a657-0af371cd766b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:16.485512 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-51f222b7-7152-412d-a657-0af371cd766b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:16.486000 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-51f222b7-7152-412d-a657-0af371cd766b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:16.486783 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-51f222b7-7152-412d-a657-0af371cd766b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:16.487224 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-51f222b7-7152-412d-a657-0af371cd766b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:16.615946 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-51f222b7-7152-412d-a657-0af371cd766b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:16.624371 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-51f222b7-7152-412d-a657-0af371cd766b tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 200 len: 1363 microversion: 2.1 time: 0.149715 May 11 07:43:16.624922 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 281/561] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:16 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:17.001954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-dd18db7f-3705-4ec9-9038-173bd59b51e6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:17.002597 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-dd18db7f-3705-4ec9-9038-173bd59b51e6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:17.008857 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dd18db7f-3705-4ec9-9038-173bd59b51e6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:17.009302 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dd18db7f-3705-4ec9-9038-173bd59b51e6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:17.010094 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dd18db7f-3705-4ec9-9038-173bd59b51e6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:17.010526 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dd18db7f-3705-4ec9-9038-173bd59b51e6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:17.146840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-dd18db7f-3705-4ec9-9038-173bd59b51e6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:17.155197 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-dd18db7f-3705-4ec9-9038-173bd59b51e6 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1759 microversion: 2.1 time: 0.157664 May 11 07:43:17.155680 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 281/562] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:16 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1759 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:17.641516 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a04e5a2e-2fa3-40dd-9a14-8284ef862ddc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:17.642166 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a04e5a2e-2fa3-40dd-9a14-8284ef862ddc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:17.648354 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a04e5a2e-2fa3-40dd-9a14-8284ef862ddc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:17.648806 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a04e5a2e-2fa3-40dd-9a14-8284ef862ddc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:17.649594 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a04e5a2e-2fa3-40dd-9a14-8284ef862ddc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:17.650038 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a04e5a2e-2fa3-40dd-9a14-8284ef862ddc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:17.779796 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a04e5a2e-2fa3-40dd-9a14-8284ef862ddc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:17.786988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a04e5a2e-2fa3-40dd-9a14-8284ef862ddc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 200 len: 1363 microversion: 2.1 time: 0.149843 May 11 07:43:17.787546 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 282/563] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:17 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:18.173125 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7f785cb3-37a9-40b2-9db0-70bff260e604 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:18.173776 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-7f785cb3-37a9-40b2-9db0-70bff260e604 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:18.180035 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7f785cb3-37a9-40b2-9db0-70bff260e604 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:18.180490 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7f785cb3-37a9-40b2-9db0-70bff260e604 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:18.181261 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7f785cb3-37a9-40b2-9db0-70bff260e604 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:18.181736 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7f785cb3-37a9-40b2-9db0-70bff260e604 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:18.317785 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-7f785cb3-37a9-40b2-9db0-70bff260e604 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:18.325619 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-7f785cb3-37a9-40b2-9db0-70bff260e604 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1759 microversion: 2.1 time: 0.157064 May 11 07:43:18.326262 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 282/564] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:18 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1759 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:18.803342 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1719f447-9ccb-491d-807e-c3733617c12d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:18.803957 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-1719f447-9ccb-491d-807e-c3733617c12d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:18.810914 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1719f447-9ccb-491d-807e-c3733617c12d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:18.811374 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1719f447-9ccb-491d-807e-c3733617c12d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:18.812187 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1719f447-9ccb-491d-807e-c3733617c12d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:18.817422 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1719f447-9ccb-491d-807e-c3733617c12d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:18.948186 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-1719f447-9ccb-491d-807e-c3733617c12d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:18.955443 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-1719f447-9ccb-491d-807e-c3733617c12d tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 200 len: 1363 microversion: 2.1 time: 0.155882 May 11 07:43:18.956002 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 283/565] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:18 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:19.233126 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-6c324d3a-d178-4f1b-a7f8-81ce3afb7940 req-d5ada894-eab1-468f-91bd-80874594db02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d19445-31da-4e52-849f-b17774fef588", "name": "network-vif-plugged", "status": "completed", "tag": "db802acb-b2fb-41d5-ae0d-61aea6391681"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:19.242991 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-6c324d3a-d178-4f1b-a7f8-81ce3afb7940 req-d5ada894-eab1-468f-91bd-80874594db02 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:19.243121 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-6c324d3a-d178-4f1b-a7f8-81ce3afb7940 req-d5ada894-eab1-468f-91bd-80874594db02 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:19.255755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-6c324d3a-d178-4f1b-a7f8-81ce3afb7940 req-d5ada894-eab1-468f-91bd-80874594db02 service nova] Creating event network-vif-plugged:db802acb-b2fb-41d5-ae0d-61aea6391681 for instance 38d19445-31da-4e52-849f-b17774fef588 on hv-cinder-83699 May 11 07:43:19.261275 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-6c324d3a-d178-4f1b-a7f8-81ce3afb7940 req-d5ada894-eab1-468f-91bd-80874594db02 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032794 May 11 07:43:19.261999 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 283/566] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:43:19.343425 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a6b24146-07c4-4b81-b460-fbb9d06a4778 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:19.344036 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a6b24146-07c4-4b81-b460-fbb9d06a4778 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:19.349971 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a6b24146-07c4-4b81-b460-fbb9d06a4778 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:19.350486 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a6b24146-07c4-4b81-b460-fbb9d06a4778 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:19.351436 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a6b24146-07c4-4b81-b460-fbb9d06a4778 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:19.351874 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a6b24146-07c4-4b81-b460-fbb9d06a4778 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:19.496995 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a6b24146-07c4-4b81-b460-fbb9d06a4778 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:19.504815 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a6b24146-07c4-4b81-b460-fbb9d06a4778 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1759 microversion: 2.1 time: 0.165693 May 11 07:43:19.505385 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 284/567] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:19 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:19.973234 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-59256952-97ea-4e99-b69e-14dbe18dd1dc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:19.973953 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-59256952-97ea-4e99-b69e-14dbe18dd1dc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:19.979985 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-59256952-97ea-4e99-b69e-14dbe18dd1dc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:19.980423 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-59256952-97ea-4e99-b69e-14dbe18dd1dc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:19.981207 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-59256952-97ea-4e99-b69e-14dbe18dd1dc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:19.981666 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-59256952-97ea-4e99-b69e-14dbe18dd1dc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:20.105078 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-59256952-97ea-4e99-b69e-14dbe18dd1dc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:20.112196 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-59256952-97ea-4e99-b69e-14dbe18dd1dc tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 200 len: 1363 microversion: 2.1 time: 0.143143 May 11 07:43:20.112746 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 284/568] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:19 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:20.523474 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-6eadc2f0-3756-455f-bcab-fe28fdb921b3 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:20.524077 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-6eadc2f0-3756-455f-bcab-fe28fdb921b3 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:20.530441 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6eadc2f0-3756-455f-bcab-fe28fdb921b3 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:20.530895 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6eadc2f0-3756-455f-bcab-fe28fdb921b3 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:20.531659 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6eadc2f0-3756-455f-bcab-fe28fdb921b3 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:20.532165 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6eadc2f0-3756-455f-bcab-fe28fdb921b3 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:20.677013 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-6eadc2f0-3756-455f-bcab-fe28fdb921b3 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:20.684670 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-6eadc2f0-3756-455f-bcab-fe28fdb921b3 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1759 microversion: 2.1 time: 0.164964 May 11 07:43:20.685770 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 285/569] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:20 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:21.129019 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-e57134cb-a753-4bc1-aff7-1cf0044d4c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:21.129653 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-e57134cb-a753-4bc1-aff7-1cf0044d4c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:21.136141 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e57134cb-a753-4bc1-aff7-1cf0044d4c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:21.136586 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e57134cb-a753-4bc1-aff7-1cf0044d4c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:21.137354 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e57134cb-a753-4bc1-aff7-1cf0044d4c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:21.138000 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e57134cb-a753-4bc1-aff7-1cf0044d4c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:21.281832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-e57134cb-a753-4bc1-aff7-1cf0044d4c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:21.289222 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-e57134cb-a753-4bc1-aff7-1cf0044d4c5c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 200 len: 1548 microversion: 2.1 time: 0.164275 May 11 07:43:21.289828 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 285/570] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:21 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:21.305685 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9bea6c16-6e00-4d96-a75f-c4d1b9125895 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:21.306182 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9bea6c16-6e00-4d96-a75f-c4d1b9125895 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:21.312030 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9bea6c16-6e00-4d96-a75f-c4d1b9125895 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:21.312478 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9bea6c16-6e00-4d96-a75f-c4d1b9125895 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:21.313237 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9bea6c16-6e00-4d96-a75f-c4d1b9125895 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:21.313716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9bea6c16-6e00-4d96-a75f-c4d1b9125895 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:21.390524 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9bea6c16-6e00-4d96-a75f-c4d1b9125895 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088631 May 11 07:43:21.391122 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 286/571] 10.222.0.36 () {58 vars in 1274 bytes} [Wed May 11 07:43:21 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:43:21.703408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-5a423213-8fa7-4dc1-a1c6-65eb71dd1cbf tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:21.704128 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-5a423213-8fa7-4dc1-a1c6-65eb71dd1cbf tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:21.710357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5a423213-8fa7-4dc1-a1c6-65eb71dd1cbf tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:21.710813 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5a423213-8fa7-4dc1-a1c6-65eb71dd1cbf tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:21.711590 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5a423213-8fa7-4dc1-a1c6-65eb71dd1cbf tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:21.712024 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5a423213-8fa7-4dc1-a1c6-65eb71dd1cbf tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:22.238324 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-5a423213-8fa7-4dc1-a1c6-65eb71dd1cbf tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:22.248928 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-5a423213-8fa7-4dc1-a1c6-65eb71dd1cbf tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1759 microversion: 2.1 time: 0.549823 May 11 07:43:22.249706 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 286/572] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:21 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1759 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:43:22.836378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-f58924b0-d0be-4865-9bb3-4c4fb97dfc1b req-223522d0-2ecf-4cd7-b610-41fcc820120d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d19445-31da-4e52-849f-b17774fef588", "tag": "db802acb-b2fb-41d5-ae0d-61aea6391681"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:22.844835 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-f58924b0-d0be-4865-9bb3-4c4fb97dfc1b req-223522d0-2ecf-4cd7-b610-41fcc820120d service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:22.845282 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-f58924b0-d0be-4865-9bb3-4c4fb97dfc1b req-223522d0-2ecf-4cd7-b610-41fcc820120d service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:22.856458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-f58924b0-d0be-4865-9bb3-4c4fb97dfc1b req-223522d0-2ecf-4cd7-b610-41fcc820120d service nova] Creating event network-changed:db802acb-b2fb-41d5-ae0d-61aea6391681 for instance 38d19445-31da-4e52-849f-b17774fef588 on hv-cinder-83699 May 11 07:43:22.863114 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-f58924b0-d0be-4865-9bb3-4c4fb97dfc1b req-223522d0-2ecf-4cd7-b610-41fcc820120d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030687 May 11 07:43:22.863707 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 287/573] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:43:23.268669 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-28ac35f0-f2ee-49ce-a048-659fb61c7149 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:23.270099 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-28ac35f0-f2ee-49ce-a048-659fb61c7149 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:23.282467 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-28ac35f0-f2ee-49ce-a048-659fb61c7149 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:23.283331 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-28ac35f0-f2ee-49ce-a048-659fb61c7149 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:23.284824 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-28ac35f0-f2ee-49ce-a048-659fb61c7149 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:23.286578 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-28ac35f0-f2ee-49ce-a048-659fb61c7149 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:23.677761 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-28ac35f0-f2ee-49ce-a048-659fb61c7149 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:23.687068 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-28ac35f0-f2ee-49ce-a048-659fb61c7149 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1759 microversion: 2.1 time: 0.423888 May 11 07:43:23.696049 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 287/574] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:23 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1759 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:24.705970 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4a1f35fa-e6c6-4d4c-b73e-ea5bb91ae66d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:24.706680 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4a1f35fa-e6c6-4d4c-b73e-ea5bb91ae66d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:24.712816 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4a1f35fa-e6c6-4d4c-b73e-ea5bb91ae66d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:24.713274 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4a1f35fa-e6c6-4d4c-b73e-ea5bb91ae66d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:24.714082 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4a1f35fa-e6c6-4d4c-b73e-ea5bb91ae66d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:24.714527 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4a1f35fa-e6c6-4d4c-b73e-ea5bb91ae66d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:25.057325 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4a1f35fa-e6c6-4d4c-b73e-ea5bb91ae66d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:25.066313 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4a1f35fa-e6c6-4d4c-b73e-ea5bb91ae66d tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1762 microversion: 2.1 time: 0.365544 May 11 07:43:25.066967 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 288/575] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:24 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1762 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:26.291458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c8fe3d81-187c-460b-b343-21163bdbcea5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:26.291985 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-c8fe3d81-187c-460b-b343-21163bdbcea5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:26.298849 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c8fe3d81-187c-460b-b343-21163bdbcea5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:26.299288 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c8fe3d81-187c-460b-b343-21163bdbcea5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:26.300041 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c8fe3d81-187c-460b-b343-21163bdbcea5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:26.300470 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c8fe3d81-187c-460b-b343-21163bdbcea5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:26.322518 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c8fe3d81-187c-460b-b343-21163bdbcea5 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7/ips" status: 200 len: 153 microversion: 2.20 time: 0.035047 May 11 07:43:26.323058 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 288/576] 10.222.0.36 () {60 vars in 1288 bytes} [Wed May 11 07:43:26 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7/ips => generated 153 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 07:43:27.065526 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-543a0962-7992-4c09-a878-829b5316ca17 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:27.066425 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-543a0962-7992-4c09-a878-829b5316ca17 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:27.072681 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-543a0962-7992-4c09-a878-829b5316ca17 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:27.073142 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-543a0962-7992-4c09-a878-829b5316ca17 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:27.073935 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-543a0962-7992-4c09-a878-829b5316ca17 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:27.074374 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-543a0962-7992-4c09-a878-829b5316ca17 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:27.099590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-543a0962-7992-4c09-a878-829b5316ca17 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Going to try to terminate instance {{(pid=123600) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:43:27.180092 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-543a0962-7992-4c09-a878-829b5316ca17 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "DELETE /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 204 len: 0 microversion: 2.1 time: 0.117844 May 11 07:43:27.180870 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 289/577] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:43:27 2022] DELETE /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:43:27.189382 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-07c2cf66-57db-41c8-9994-2d74a5a21af3 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:27.190022 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-07c2cf66-57db-41c8-9994-2d74a5a21af3 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:27.196397 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-07c2cf66-57db-41c8-9994-2d74a5a21af3 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:27.196852 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-07c2cf66-57db-41c8-9994-2d74a5a21af3 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:27.197703 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-07c2cf66-57db-41c8-9994-2d74a5a21af3 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:27.198148 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-07c2cf66-57db-41c8-9994-2d74a5a21af3 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:27.326167 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-07c2cf66-57db-41c8-9994-2d74a5a21af3 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:27.333495 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-07c2cf66-57db-41c8-9994-2d74a5a21af3 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1575 microversion: 2.1 time: 0.148472 May 11 07:43:27.334072 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 289/578] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:27 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:28.350559 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d29b7963-726b-4ea6-9901-5ad33d17126d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:28.351285 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d29b7963-726b-4ea6-9901-5ad33d17126d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:28.357499 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d29b7963-726b-4ea6-9901-5ad33d17126d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:28.357985 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d29b7963-726b-4ea6-9901-5ad33d17126d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:28.358751 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d29b7963-726b-4ea6-9901-5ad33d17126d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:28.359184 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d29b7963-726b-4ea6-9901-5ad33d17126d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:28.536531 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d29b7963-726b-4ea6-9901-5ad33d17126d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:28.544256 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d29b7963-726b-4ea6-9901-5ad33d17126d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1575 microversion: 2.1 time: 0.197837 May 11 07:43:28.544830 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 290/579] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:28 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1575 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:28.916285 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-9647c0f3-64bf-4572-9fdc-12097f4ffde9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:28.916893 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-9647c0f3-64bf-4572-9fdc-12097f4ffde9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:28.924465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9647c0f3-64bf-4572-9fdc-12097f4ffde9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:28.924916 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9647c0f3-64bf-4572-9fdc-12097f4ffde9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:28.925748 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9647c0f3-64bf-4572-9fdc-12097f4ffde9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:28.926171 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9647c0f3-64bf-4572-9fdc-12097f4ffde9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:28.949558 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.objects.instance [None req-9647c0f3-64bf-4572-9fdc-12097f4ffde9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lazy-loading 'flavor' on Instance uuid d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 {{(pid=123599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:43:29.211582 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-9647c0f3-64bf-4572-9fdc-12097f4ffde9 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "POST /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7/action" status: 202 len: 0 microversion: 2.20 time: 0.299191 May 11 07:43:29.214969 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 290/580] 10.222.0.36 () {62 vars in 1318 bytes} [Wed May 11 07:43:28 2022] POST /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 07:43:29.220608 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8b0d6963-6a11-427d-a5ef-002842f38aaa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:29.221214 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8b0d6963-6a11-427d-a5ef-002842f38aaa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:29.230604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8b0d6963-6a11-427d-a5ef-002842f38aaa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:29.231059 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8b0d6963-6a11-427d-a5ef-002842f38aaa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:29.232389 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8b0d6963-6a11-427d-a5ef-002842f38aaa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:29.233007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8b0d6963-6a11-427d-a5ef-002842f38aaa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:29.375353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8b0d6963-6a11-427d-a5ef-002842f38aaa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:29.383029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8b0d6963-6a11-427d-a5ef-002842f38aaa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:29.384515 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8b0d6963-6a11-427d-a5ef-002842f38aaa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:29.385877 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8b0d6963-6a11-427d-a5ef-002842f38aaa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.169554 May 11 07:43:29.386425 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 291/581] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:29 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:29.562585 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-36d38dbe-7611-4f3e-8c90-d2348ff855bd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:29.563275 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-36d38dbe-7611-4f3e-8c90-d2348ff855bd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:29.569980 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-36d38dbe-7611-4f3e-8c90-d2348ff855bd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:29.570675 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-36d38dbe-7611-4f3e-8c90-d2348ff855bd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:29.571447 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-36d38dbe-7611-4f3e-8c90-d2348ff855bd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:29.571871 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-36d38dbe-7611-4f3e-8c90-d2348ff855bd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:29.720027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-36d38dbe-7611-4f3e-8c90-d2348ff855bd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:29.728602 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-36d38dbe-7611-4f3e-8c90-d2348ff855bd tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1575 microversion: 2.1 time: 0.170894 May 11 07:43:29.729175 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 291/582] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:29 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:30.375692 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-ba36c4d5-9148-476c-9958-610b50672111 req-a4a03e86-c164-4286-a174-96c945ac79e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0", "name": "network-vif-deleted", "tag": "984a3ee7-17e5-4143-9062-ba7a44b7d5ad"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:30.384498 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-ba36c4d5-9148-476c-9958-610b50672111 req-a4a03e86-c164-4286-a174-96c945ac79e0 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:30.385032 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-ba36c4d5-9148-476c-9958-610b50672111 req-a4a03e86-c164-4286-a174-96c945ac79e0 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:30.401790 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-ba36c4d5-9148-476c-9958-610b50672111 req-a4a03e86-c164-4286-a174-96c945ac79e0 service nova] Creating event network-vif-deleted:984a3ee7-17e5-4143-9062-ba7a44b7d5ad for instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 on hv-cinder-83699 May 11 07:43:30.407395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-ba36c4d5-9148-476c-9958-610b50672111 req-a4a03e86-c164-4286-a174-96c945ac79e0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036064 May 11 07:43:30.408575 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 292/583] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:43:30.410984 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-eef5773b-fc31-47f7-83b0-91bb305da4b0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:30.416195 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-eef5773b-fc31-47f7-83b0-91bb305da4b0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:30.428778 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-eef5773b-fc31-47f7-83b0-91bb305da4b0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:30.429417 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-eef5773b-fc31-47f7-83b0-91bb305da4b0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:30.437953 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-eef5773b-fc31-47f7-83b0-91bb305da4b0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:30.438423 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-eef5773b-fc31-47f7-83b0-91bb305da4b0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:30.613608 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-eef5773b-fc31-47f7-83b0-91bb305da4b0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:30.630626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-eef5773b-fc31-47f7-83b0-91bb305da4b0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:30.632617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-eef5773b-fc31-47f7-83b0-91bb305da4b0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:30.644422 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-eef5773b-fc31-47f7-83b0-91bb305da4b0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.243661 May 11 07:43:30.645198 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 292/584] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:30 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:30.746455 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-19ae0f13-306e-4fd8-b000-9da1587fbe52 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:30.747478 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-19ae0f13-306e-4fd8-b000-9da1587fbe52 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:30.754512 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-19ae0f13-306e-4fd8-b000-9da1587fbe52 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:30.755277 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-19ae0f13-306e-4fd8-b000-9da1587fbe52 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:30.756230 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-19ae0f13-306e-4fd8-b000-9da1587fbe52 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:30.756700 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-19ae0f13-306e-4fd8-b000-9da1587fbe52 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:30.791697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-19ae0f13-306e-4fd8-b000-9da1587fbe52 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:30.792156 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-19ae0f13-306e-4fd8-b000-9da1587fbe52 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:30.792642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.objects.instance [None req-19ae0f13-306e-4fd8-b000-9da1587fbe52 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lazy-loading 'fault' on Instance uuid 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 {{(pid=123600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:43:30.834604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-19ae0f13-306e-4fd8-b000-9da1587fbe52 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:30.842411 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-19ae0f13-306e-4fd8-b000-9da1587fbe52 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 200 len: 1229 microversion: 2.1 time: 0.100507 May 11 07:43:30.843012 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 293/585] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:30 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:31.663828 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-67312d6f-5bea-4bd5-905d-123b982c6040 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:31.664432 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-67312d6f-5bea-4bd5-905d-123b982c6040 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:31.671185 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-67312d6f-5bea-4bd5-905d-123b982c6040 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:31.671627 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-67312d6f-5bea-4bd5-905d-123b982c6040 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:31.672413 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-67312d6f-5bea-4bd5-905d-123b982c6040 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:31.672846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-67312d6f-5bea-4bd5-905d-123b982c6040 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:31.820584 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-67312d6f-5bea-4bd5-905d-123b982c6040 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:31.828225 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-67312d6f-5bea-4bd5-905d-123b982c6040 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:31.829754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-67312d6f-5bea-4bd5-905d-123b982c6040 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:31.830936 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-67312d6f-5bea-4bd5-905d-123b982c6040 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.170981 May 11 07:43:31.831518 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 293/586] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:31 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:31.859801 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7a0fc45b-a3c2-41b5-b1b9-776806185d13 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:31.860401 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7a0fc45b-a3c2-41b5-b1b9-776806185d13 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:31.866939 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7a0fc45b-a3c2-41b5-b1b9-776806185d13 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:31.867403 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7a0fc45b-a3c2-41b5-b1b9-776806185d13 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:31.868178 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7a0fc45b-a3c2-41b5-b1b9-776806185d13 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:31.868621 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7a0fc45b-a3c2-41b5-b1b9-776806185d13 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:31.882424 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-7a0fc45b-a3c2-41b5-b1b9-776806185d13 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] HTTP exception thrown: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7a0fc45b-a3c2-41b5-b1b9-776806185d13 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Request method failure captured: May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 HTTP/1.1 May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2hnZTkv4g9BV5n-cbOPQ00L4l2-HTmWB9owZvJHm1tJ_wg87Z4Sr1LURPuL-oSU2aDDhC_-PYXVMaxM8-zOAcHvyarmXPQWfuYs-IAE_RTnXM3KCWHI4mmn841AmZTVHCscJvTgQkbqvxVEn_bTeS-eA7CejvixEGNMBAPK-xmAOUY May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: d69ae02f1e0146c795d799160ac17d44 May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-TestVolumeBootPattern-1927038692 May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:43:31.884041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:43:31.885635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d69ae02f1e0146c795d799160ac17d44", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d69ae02f1e0146c795d799160ac17d44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d69ae02f1e0146c795d799160ac17d44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d69ae02f1e0146c795d799160ac17d44"}]}] May 11 07:43:31.885635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-TestVolumeBootPattern-1927038692 May 11 07:43:31.885635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: d69ae02f1e0146c795d799160ac17d44 May 11 07:43:31.885635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-TestVolumeBootPattern-1927038692 May 11 07:43:31.885635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-TestVolumeBootPattern-1927038692-project May 11 07:43:31.885635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:43:31.885635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:43:31.885635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: ed2dae16f03c4eff9185087ed50120fc May 11 07:43:31.885635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-TestVolumeBootPattern-1927038692-project May 11 07:43:31.885635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:43:31.885635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:43:31.885635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0'} May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:43:31.886589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:43:31.888084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:43:31.889519 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7a0fc45b-a3c2-41b5-b1b9-776806185d13 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Returning 404 to user: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:43:31.889519 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7a0fc45b-a3c2-41b5-b1b9-776806185d13 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 404 len: 111 microversion: 2.1 time: 0.029922 May 11 07:43:31.889519 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 294/587] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:31 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:43:32.037207 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1130458620", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-678948032", "security_groups": [{"name": "tempest-secgroup-smoke-402851186"}], "block_device_mapping_v2": [{"uuid": "b55a0a72-0237-4c3e-8b13-a608bc854c55", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "55b96101-3633-4a8d-a623-73556fb91d7c"}]}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:32.152277 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.network.neutron [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] validate_networks() for [('55b96101-3633-4a8d-a623-73556fb91d7c', None, None, None, None, None)] {{(pid=123599) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:43:32.519987 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Flavor limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:43:32.520403 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Image limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:43:32.520873 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Flavor pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:43:32.521276 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Image pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:43:32.521771 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:43:32.531220 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:32.531665 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:32.532650 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:32.533114 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:32.551969 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Getting quotas for project d69ae02f1e0146c795d799160ac17d44. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:43:32.555837 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Getting quotas for user ed2dae16f03c4eff9185087ed50120fc and project d69ae02f1e0146c795d799160ac17d44. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:43:32.611121 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Going to run 1 instances... {{(pid=123599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:43:32.613373 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b55a0a72-0237-4c3e-8b13-a608bc854c55',volume_size=None,volume_type=None)] {{(pid=123599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:43:32.740926 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-6f702905-a8eb-4944-a259-07bbdecf89d4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.707489 May 11 07:43:32.745707 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 294/588] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:43:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:43:32.756163 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7a359e6b-9215-4e33-be2a-2a1c6d91465a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:32.757708 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7a359e6b-9215-4e33-be2a-2a1c6d91465a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:32.810433 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7a359e6b-9215-4e33-be2a-2a1c6d91465a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:32.817338 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7a359e6b-9215-4e33-be2a-2a1c6d91465a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1094 microversion: 2.1 time: 0.065018 May 11 07:43:32.817920 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 295/589] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:32 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:33.028977 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-4a962312-6920-4d66-85dc-3d63b1e987bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:33.029531 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-4a962312-6920-4d66-85dc-3d63b1e987bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:33.035586 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4a962312-6920-4d66-85dc-3d63b1e987bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:33.036043 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4a962312-6920-4d66-85dc-3d63b1e987bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:33.036821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4a962312-6920-4d66-85dc-3d63b1e987bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:33.037260 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4a962312-6920-4d66-85dc-3d63b1e987bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:33.189019 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-4a962312-6920-4d66-85dc-3d63b1e987bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:33.197751 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-4a962312-6920-4d66-85dc-3d63b1e987bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:33.199284 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-4a962312-6920-4d66-85dc-3d63b1e987bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:33.200726 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-4a962312-6920-4d66-85dc-3d63b1e987bf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.353879 May 11 07:43:33.201658 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 295/590] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:32 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:33.835599 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-47eacc38-207d-4dfd-9d35-5d207e892900 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:33.836584 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-47eacc38-207d-4dfd-9d35-5d207e892900 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:33.847346 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-47eacc38-207d-4dfd-9d35-5d207e892900 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:33.848209 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-47eacc38-207d-4dfd-9d35-5d207e892900 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:33.850088 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-47eacc38-207d-4dfd-9d35-5d207e892900 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:33.850738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-47eacc38-207d-4dfd-9d35-5d207e892900 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:33.914314 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-47eacc38-207d-4dfd-9d35-5d207e892900 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:33.921904 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-47eacc38-207d-4dfd-9d35-5d207e892900 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1200 microversion: 2.1 time: 0.090824 May 11 07:43:33.922758 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 296/591] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:33 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:34.220893 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6ffe4cfb-90c8-47cb-bd15-8aed7f4b3389 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:34.221493 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-6ffe4cfb-90c8-47cb-bd15-8aed7f4b3389 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:34.227402 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6ffe4cfb-90c8-47cb-bd15-8aed7f4b3389 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:34.227930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6ffe4cfb-90c8-47cb-bd15-8aed7f4b3389 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:34.228680 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6ffe4cfb-90c8-47cb-bd15-8aed7f4b3389 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:34.229152 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6ffe4cfb-90c8-47cb-bd15-8aed7f4b3389 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:34.362119 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-6ffe4cfb-90c8-47cb-bd15-8aed7f4b3389 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:34.373455 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-6ffe4cfb-90c8-47cb-bd15-8aed7f4b3389 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:34.375432 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-6ffe4cfb-90c8-47cb-bd15-8aed7f4b3389 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:34.376974 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-6ffe4cfb-90c8-47cb-bd15-8aed7f4b3389 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.160753 May 11 07:43:34.377555 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 296/592] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:34 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:34.938430 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f27e7df1-ac67-4d37-949a-e7417c817ea4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:34.939049 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f27e7df1-ac67-4d37-949a-e7417c817ea4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:34.946014 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f27e7df1-ac67-4d37-949a-e7417c817ea4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:34.946469 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f27e7df1-ac67-4d37-949a-e7417c817ea4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:34.947245 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f27e7df1-ac67-4d37-949a-e7417c817ea4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:34.947679 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f27e7df1-ac67-4d37-949a-e7417c817ea4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:35.092883 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f27e7df1-ac67-4d37-949a-e7417c817ea4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:35.101011 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f27e7df1-ac67-4d37-949a-e7417c817ea4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1265 microversion: 2.1 time: 0.166423 May 11 07:43:35.101613 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 297/593] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:34 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:35.274968 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-6a6a34e7-e058-4b51-9ce1-8cb2a378b32e req-f5035c2a-eab2-4902-a832-a76d58760481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69085008-f940-4f96-936a-e0311df279c7", "tag": "a2bb40c8-8fd7-4b35-a542-bf1d3ba6c9e4"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:35.302486 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-6a6a34e7-e058-4b51-9ce1-8cb2a378b32e req-f5035c2a-eab2-4902-a832-a76d58760481 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:35.303176 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-6a6a34e7-e058-4b51-9ce1-8cb2a378b32e req-f5035c2a-eab2-4902-a832-a76d58760481 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:35.317448 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-6a6a34e7-e058-4b51-9ce1-8cb2a378b32e req-f5035c2a-eab2-4902-a832-a76d58760481 service nova] Creating event network-changed:a2bb40c8-8fd7-4b35-a542-bf1d3ba6c9e4 for instance 69085008-f940-4f96-936a-e0311df279c7 on hv-cinder-83699 May 11 07:43:35.323960 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-6a6a34e7-e058-4b51-9ce1-8cb2a378b32e req-f5035c2a-eab2-4902-a832-a76d58760481 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053270 May 11 07:43:35.326512 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 297/594] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:43:35.395722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-feec4afe-b117-43df-b159-e7e62929f414 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:35.396333 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-feec4afe-b117-43df-b159-e7e62929f414 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:35.402585 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-feec4afe-b117-43df-b159-e7e62929f414 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:35.403041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-feec4afe-b117-43df-b159-e7e62929f414 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:35.403875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-feec4afe-b117-43df-b159-e7e62929f414 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:35.404347 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-feec4afe-b117-43df-b159-e7e62929f414 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:35.559062 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-feec4afe-b117-43df-b159-e7e62929f414 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:35.567640 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-feec4afe-b117-43df-b159-e7e62929f414 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:35.569120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-feec4afe-b117-43df-b159-e7e62929f414 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:35.570306 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-feec4afe-b117-43df-b159-e7e62929f414 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.178579 May 11 07:43:35.570865 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 298/595] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:35 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:36.120353 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2e698ea8-9cff-4ea3-85a1-2d3a29ee2d32 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:36.121044 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2e698ea8-9cff-4ea3-85a1-2d3a29ee2d32 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:36.127205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2e698ea8-9cff-4ea3-85a1-2d3a29ee2d32 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:36.127651 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2e698ea8-9cff-4ea3-85a1-2d3a29ee2d32 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:36.128415 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2e698ea8-9cff-4ea3-85a1-2d3a29ee2d32 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:36.128852 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2e698ea8-9cff-4ea3-85a1-2d3a29ee2d32 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:36.264096 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2e698ea8-9cff-4ea3-85a1-2d3a29ee2d32 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:36.271723 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2e698ea8-9cff-4ea3-85a1-2d3a29ee2d32 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1265 microversion: 2.1 time: 0.155530 May 11 07:43:36.272293 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 298/596] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:36 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:36.587540 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a9553cfa-c20f-4b35-8f29-5ddbbf491986 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:36.588137 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a9553cfa-c20f-4b35-8f29-5ddbbf491986 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:36.594489 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a9553cfa-c20f-4b35-8f29-5ddbbf491986 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:36.594935 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a9553cfa-c20f-4b35-8f29-5ddbbf491986 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:36.595698 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a9553cfa-c20f-4b35-8f29-5ddbbf491986 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:36.596130 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a9553cfa-c20f-4b35-8f29-5ddbbf491986 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:36.729469 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a9553cfa-c20f-4b35-8f29-5ddbbf491986 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:36.737087 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a9553cfa-c20f-4b35-8f29-5ddbbf491986 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:36.738587 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a9553cfa-c20f-4b35-8f29-5ddbbf491986 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:36.739723 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a9553cfa-c20f-4b35-8f29-5ddbbf491986 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.156051 May 11 07:43:36.740269 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 299/597] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:36 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:37.288131 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c0a714f1-8edf-4194-aeca-8360cc44a03c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:37.288734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-c0a714f1-8edf-4194-aeca-8360cc44a03c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:37.295686 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c0a714f1-8edf-4194-aeca-8360cc44a03c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:37.296147 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c0a714f1-8edf-4194-aeca-8360cc44a03c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:37.296897 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c0a714f1-8edf-4194-aeca-8360cc44a03c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:37.297323 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c0a714f1-8edf-4194-aeca-8360cc44a03c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:37.427354 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-c0a714f1-8edf-4194-aeca-8360cc44a03c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:37.434582 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c0a714f1-8edf-4194-aeca-8360cc44a03c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1265 microversion: 2.1 time: 0.150204 May 11 07:43:37.435136 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 299/598] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:37 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:43:37.758132 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-89caf271-da3a-4568-81ed-fa8f4c34131f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:37.758737 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-89caf271-da3a-4568-81ed-fa8f4c34131f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:37.765605 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-89caf271-da3a-4568-81ed-fa8f4c34131f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:37.766082 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-89caf271-da3a-4568-81ed-fa8f4c34131f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:37.766847 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-89caf271-da3a-4568-81ed-fa8f4c34131f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:37.767286 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-89caf271-da3a-4568-81ed-fa8f4c34131f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:37.896111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-89caf271-da3a-4568-81ed-fa8f4c34131f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:37.905480 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-89caf271-da3a-4568-81ed-fa8f4c34131f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:37.907034 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-89caf271-da3a-4568-81ed-fa8f4c34131f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:37.908228 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-89caf271-da3a-4568-81ed-fa8f4c34131f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.154038 May 11 07:43:37.908783 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 300/599] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:37 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:38.451469 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-dd9851a3-debb-45d4-882d-1cd005879d6a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:38.452217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-dd9851a3-debb-45d4-882d-1cd005879d6a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:38.458585 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dd9851a3-debb-45d4-882d-1cd005879d6a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:38.459039 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dd9851a3-debb-45d4-882d-1cd005879d6a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:38.459806 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dd9851a3-debb-45d4-882d-1cd005879d6a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:38.460243 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dd9851a3-debb-45d4-882d-1cd005879d6a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:38.591398 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-dd9851a3-debb-45d4-882d-1cd005879d6a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:38.598693 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-dd9851a3-debb-45d4-882d-1cd005879d6a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1265 microversion: 2.1 time: 0.151071 May 11 07:43:38.599261 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 300/600] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:38 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:38.926258 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-050a2ca7-8248-442d-87bf-79a65b41a910 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:38.926878 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-050a2ca7-8248-442d-87bf-79a65b41a910 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:38.933158 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-050a2ca7-8248-442d-87bf-79a65b41a910 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:38.933578 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-050a2ca7-8248-442d-87bf-79a65b41a910 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:38.934345 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-050a2ca7-8248-442d-87bf-79a65b41a910 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:38.934777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-050a2ca7-8248-442d-87bf-79a65b41a910 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:39.065610 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-050a2ca7-8248-442d-87bf-79a65b41a910 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:39.073884 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-050a2ca7-8248-442d-87bf-79a65b41a910 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:39.075876 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-050a2ca7-8248-442d-87bf-79a65b41a910 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:39.077029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-050a2ca7-8248-442d-87bf-79a65b41a910 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.154698 May 11 07:43:39.077845 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 301/601] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:38 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:39.616692 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-5ab6119d-ffcc-4022-9a02-33acb2371352 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:39.617227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-5ab6119d-ffcc-4022-9a02-33acb2371352 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:39.624340 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ab6119d-ffcc-4022-9a02-33acb2371352 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:39.624784 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ab6119d-ffcc-4022-9a02-33acb2371352 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:39.625564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ab6119d-ffcc-4022-9a02-33acb2371352 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:39.625993 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ab6119d-ffcc-4022-9a02-33acb2371352 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:39.760834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-5ab6119d-ffcc-4022-9a02-33acb2371352 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:39.768932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-5ab6119d-ffcc-4022-9a02-33acb2371352 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1265 microversion: 2.1 time: 0.156097 May 11 07:43:39.769502 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 301/602] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:39 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:40.095291 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-bee9d87d-a23d-4350-b119-ea3b70fbb7e4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:40.095905 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-bee9d87d-a23d-4350-b119-ea3b70fbb7e4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:40.102326 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bee9d87d-a23d-4350-b119-ea3b70fbb7e4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:40.102783 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bee9d87d-a23d-4350-b119-ea3b70fbb7e4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:40.103554 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bee9d87d-a23d-4350-b119-ea3b70fbb7e4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:40.103995 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bee9d87d-a23d-4350-b119-ea3b70fbb7e4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:40.230715 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-bee9d87d-a23d-4350-b119-ea3b70fbb7e4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:40.239023 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-bee9d87d-a23d-4350-b119-ea3b70fbb7e4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:40.240532 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-bee9d87d-a23d-4350-b119-ea3b70fbb7e4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:40.241717 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-bee9d87d-a23d-4350-b119-ea3b70fbb7e4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.150381 May 11 07:43:40.242275 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 302/603] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:40 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:40.785950 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-503ad12d-cad8-4c9b-b349-e39ce350fad8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:40.786565 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-503ad12d-cad8-4c9b-b349-e39ce350fad8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:40.792885 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-503ad12d-cad8-4c9b-b349-e39ce350fad8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:40.793336 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-503ad12d-cad8-4c9b-b349-e39ce350fad8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:40.794621 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-503ad12d-cad8-4c9b-b349-e39ce350fad8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:40.795057 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-503ad12d-cad8-4c9b-b349-e39ce350fad8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:40.922357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-503ad12d-cad8-4c9b-b349-e39ce350fad8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:40.929483 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-503ad12d-cad8-4c9b-b349-e39ce350fad8 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1265 microversion: 2.1 time: 0.147385 May 11 07:43:40.930065 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 302/604] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:40 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:41.259665 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-75aa7b0a-ef0f-4006-b52d-7754b19f2b1b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:41.260272 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-75aa7b0a-ef0f-4006-b52d-7754b19f2b1b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:41.266291 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-75aa7b0a-ef0f-4006-b52d-7754b19f2b1b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:41.266739 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-75aa7b0a-ef0f-4006-b52d-7754b19f2b1b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:41.267491 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-75aa7b0a-ef0f-4006-b52d-7754b19f2b1b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:41.267955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-75aa7b0a-ef0f-4006-b52d-7754b19f2b1b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:41.392038 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-75aa7b0a-ef0f-4006-b52d-7754b19f2b1b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:41.399565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-75aa7b0a-ef0f-4006-b52d-7754b19f2b1b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:41.401045 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-75aa7b0a-ef0f-4006-b52d-7754b19f2b1b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:41.402207 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-75aa7b0a-ef0f-4006-b52d-7754b19f2b1b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.146403 May 11 07:43:41.402756 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 303/605] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:41 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:41.947041 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-5ba5f1e3-05e4-4412-943b-9a8421b2bf3a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:41.947680 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-5ba5f1e3-05e4-4412-943b-9a8421b2bf3a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:41.954676 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ba5f1e3-05e4-4412-943b-9a8421b2bf3a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:41.955126 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ba5f1e3-05e4-4412-943b-9a8421b2bf3a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:41.955904 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ba5f1e3-05e4-4412-943b-9a8421b2bf3a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:41.956346 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5ba5f1e3-05e4-4412-943b-9a8421b2bf3a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:42.092538 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-5ba5f1e3-05e4-4412-943b-9a8421b2bf3a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:42.100227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-5ba5f1e3-05e4-4412-943b-9a8421b2bf3a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1265 microversion: 2.1 time: 0.157146 May 11 07:43:42.100781 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 303/606] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:41 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:42.425672 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-23efe0e2-102e-4772-b117-c9e044ce5f3c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:42.426277 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-23efe0e2-102e-4772-b117-c9e044ce5f3c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:42.432542 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-23efe0e2-102e-4772-b117-c9e044ce5f3c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:42.432989 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-23efe0e2-102e-4772-b117-c9e044ce5f3c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:42.433775 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-23efe0e2-102e-4772-b117-c9e044ce5f3c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:42.434215 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-23efe0e2-102e-4772-b117-c9e044ce5f3c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:42.560777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-23efe0e2-102e-4772-b117-c9e044ce5f3c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:42.568670 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-23efe0e2-102e-4772-b117-c9e044ce5f3c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:42.570246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-23efe0e2-102e-4772-b117-c9e044ce5f3c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:42.571395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-23efe0e2-102e-4772-b117-c9e044ce5f3c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.149597 May 11 07:43:42.571943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 304/607] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:42 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:43.117406 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-21d81b77-4a54-494f-9a29-4c10d1aabf9d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:43.118054 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-21d81b77-4a54-494f-9a29-4c10d1aabf9d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:43.124378 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-21d81b77-4a54-494f-9a29-4c10d1aabf9d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:43.124831 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-21d81b77-4a54-494f-9a29-4c10d1aabf9d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:43.125624 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-21d81b77-4a54-494f-9a29-4c10d1aabf9d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:43.126069 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-21d81b77-4a54-494f-9a29-4c10d1aabf9d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:43.252069 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-21d81b77-4a54-494f-9a29-4c10d1aabf9d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:43.259357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-21d81b77-4a54-494f-9a29-4c10d1aabf9d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1265 microversion: 2.1 time: 0.145797 May 11 07:43:43.259927 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 304/608] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:43 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:43.592101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-be042d11-ee33-48e5-9290-b702c1a29670 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:43.592741 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-be042d11-ee33-48e5-9290-b702c1a29670 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:43.599147 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-be042d11-ee33-48e5-9290-b702c1a29670 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:43.599596 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-be042d11-ee33-48e5-9290-b702c1a29670 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:43.600357 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-be042d11-ee33-48e5-9290-b702c1a29670 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:43.600795 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-be042d11-ee33-48e5-9290-b702c1a29670 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:43.733522 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-be042d11-ee33-48e5-9290-b702c1a29670 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:43.741648 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-be042d11-ee33-48e5-9290-b702c1a29670 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:43.743248 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-be042d11-ee33-48e5-9290-b702c1a29670 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:43.744398 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-be042d11-ee33-48e5-9290-b702c1a29670 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.156207 May 11 07:43:43.744959 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 305/609] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:43 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:44.276448 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-108bdcc4-74dc-4730-a944-58d5bd521ca7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:44.277059 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-108bdcc4-74dc-4730-a944-58d5bd521ca7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:44.283854 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-108bdcc4-74dc-4730-a944-58d5bd521ca7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:44.284299 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-108bdcc4-74dc-4730-a944-58d5bd521ca7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:44.285062 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-108bdcc4-74dc-4730-a944-58d5bd521ca7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:44.285512 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-108bdcc4-74dc-4730-a944-58d5bd521ca7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:44.410887 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-108bdcc4-74dc-4730-a944-58d5bd521ca7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:44.418144 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-108bdcc4-74dc-4730-a944-58d5bd521ca7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1265 microversion: 2.1 time: 0.145563 May 11 07:43:44.418702 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 305/610] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:44 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:44.764501 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-cdadde66-27ab-46d5-81b8-faf09a1ec95a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:44.765145 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-cdadde66-27ab-46d5-81b8-faf09a1ec95a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:44.771512 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cdadde66-27ab-46d5-81b8-faf09a1ec95a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:44.771970 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cdadde66-27ab-46d5-81b8-faf09a1ec95a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:44.772752 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cdadde66-27ab-46d5-81b8-faf09a1ec95a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:44.773194 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cdadde66-27ab-46d5-81b8-faf09a1ec95a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:44.905399 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-cdadde66-27ab-46d5-81b8-faf09a1ec95a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:44.913034 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-cdadde66-27ab-46d5-81b8-faf09a1ec95a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:44.914558 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-cdadde66-27ab-46d5-81b8-faf09a1ec95a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:44.915699 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-cdadde66-27ab-46d5-81b8-faf09a1ec95a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.155718 May 11 07:43:44.916249 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 306/611] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:44 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:45.322317 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-13648c98-f860-440a-8d42-fe015c4b7761 req-1643e4b4-f77e-4b75-9ae4-ed80bf2247a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69085008-f940-4f96-936a-e0311df279c7", "name": "network-vif-plugged", "status": "completed", "tag": "a2bb40c8-8fd7-4b35-a542-bf1d3ba6c9e4"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:45.331313 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-13648c98-f860-440a-8d42-fe015c4b7761 req-1643e4b4-f77e-4b75-9ae4-ed80bf2247a9 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:45.331654 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-13648c98-f860-440a-8d42-fe015c4b7761 req-1643e4b4-f77e-4b75-9ae4-ed80bf2247a9 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:45.342775 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-13648c98-f860-440a-8d42-fe015c4b7761 req-1643e4b4-f77e-4b75-9ae4-ed80bf2247a9 service nova] Creating event network-vif-plugged:a2bb40c8-8fd7-4b35-a542-bf1d3ba6c9e4 for instance 69085008-f940-4f96-936a-e0311df279c7 on hv-cinder-83699 May 11 07:43:45.347382 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-13648c98-f860-440a-8d42-fe015c4b7761 req-1643e4b4-f77e-4b75-9ae4-ed80bf2247a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028876 May 11 07:43:45.347956 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 306/612] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:43:45.435261 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-eaa6efde-ca28-422e-8aa2-4d694d015146 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:45.435796 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-eaa6efde-ca28-422e-8aa2-4d694d015146 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:45.441948 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-eaa6efde-ca28-422e-8aa2-4d694d015146 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:45.442396 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-eaa6efde-ca28-422e-8aa2-4d694d015146 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:45.443151 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-eaa6efde-ca28-422e-8aa2-4d694d015146 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:45.443582 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-eaa6efde-ca28-422e-8aa2-4d694d015146 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:45.577693 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-eaa6efde-ca28-422e-8aa2-4d694d015146 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:45.584778 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-eaa6efde-ca28-422e-8aa2-4d694d015146 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1265 microversion: 2.1 time: 0.154048 May 11 07:43:45.585331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 307/613] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:45 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:45.933877 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a5e61d90-5502-4390-b75e-81220df6992d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:45.934587 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a5e61d90-5502-4390-b75e-81220df6992d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:45.940542 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a5e61d90-5502-4390-b75e-81220df6992d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:45.941248 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a5e61d90-5502-4390-b75e-81220df6992d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:45.942044 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a5e61d90-5502-4390-b75e-81220df6992d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:45.942486 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a5e61d90-5502-4390-b75e-81220df6992d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:46.090296 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a5e61d90-5502-4390-b75e-81220df6992d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:46.110372 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a5e61d90-5502-4390-b75e-81220df6992d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:46.111867 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a5e61d90-5502-4390-b75e-81220df6992d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:46.113352 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a5e61d90-5502-4390-b75e-81220df6992d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1745 microversion: 2.20 time: 0.183373 May 11 07:43:46.113568 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 307/614] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:45 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:46.601622 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ca4e7974-b808-4b6c-9628-2e975089e597 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:46.602233 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-ca4e7974-b808-4b6c-9628-2e975089e597 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:46.609087 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ca4e7974-b808-4b6c-9628-2e975089e597 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:46.609559 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ca4e7974-b808-4b6c-9628-2e975089e597 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:46.610359 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ca4e7974-b808-4b6c-9628-2e975089e597 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:46.610795 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ca4e7974-b808-4b6c-9628-2e975089e597 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:46.737829 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-ca4e7974-b808-4b6c-9628-2e975089e597 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:46.745084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-ca4e7974-b808-4b6c-9628-2e975089e597 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1265 microversion: 2.1 time: 0.147454 May 11 07:43:46.745668 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 308/615] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:46 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:47.131600 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-168295e4-642a-44ea-bb91-598bd9782fb2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:47.132119 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-168295e4-642a-44ea-bb91-598bd9782fb2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:47.138665 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-168295e4-642a-44ea-bb91-598bd9782fb2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:47.139109 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-168295e4-642a-44ea-bb91-598bd9782fb2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:47.139866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-168295e4-642a-44ea-bb91-598bd9782fb2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:47.140292 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-168295e4-642a-44ea-bb91-598bd9782fb2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:47.288844 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-168295e4-642a-44ea-bb91-598bd9782fb2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:47.316145 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-168295e4-642a-44ea-bb91-598bd9782fb2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:47.319891 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-168295e4-642a-44ea-bb91-598bd9782fb2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:47.323211 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-168295e4-642a-44ea-bb91-598bd9782fb2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1745 microversion: 2.20 time: 0.194984 May 11 07:43:47.324339 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 308/616] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:47 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1745 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:47.761629 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ec2eb5ea-e2d9-4f33-a7db-e7236396d4ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:47.762292 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-ec2eb5ea-e2d9-4f33-a7db-e7236396d4ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:47.769048 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ec2eb5ea-e2d9-4f33-a7db-e7236396d4ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:47.770712 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ec2eb5ea-e2d9-4f33-a7db-e7236396d4ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:47.771597 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ec2eb5ea-e2d9-4f33-a7db-e7236396d4ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:47.772135 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ec2eb5ea-e2d9-4f33-a7db-e7236396d4ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:47.906918 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-ec2eb5ea-e2d9-4f33-a7db-e7236396d4ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:47.914693 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-ec2eb5ea-e2d9-4f33-a7db-e7236396d4ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1452 microversion: 2.1 time: 0.156792 May 11 07:43:47.915333 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 309/617] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:47 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:47.933255 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3f3b5586-c97d-4369-a90b-a54a38b263e1 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:47.935064 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-3f3b5586-c97d-4369-a90b-a54a38b263e1 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:47.941985 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3f3b5586-c97d-4369-a90b-a54a38b263e1 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:47.942663 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3f3b5586-c97d-4369-a90b-a54a38b263e1 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:47.943645 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3f3b5586-c97d-4369-a90b-a54a38b263e1 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:47.944245 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3f3b5586-c97d-4369-a90b-a54a38b263e1 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:48.083894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-3f3b5586-c97d-4369-a90b-a54a38b263e1 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:48.092269 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-3f3b5586-c97d-4369-a90b-a54a38b263e1 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1452 microversion: 2.1 time: 0.165267 May 11 07:43:48.092850 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 309/618] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:43:47 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:43:48.345191 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-0ddc1527-eb2f-472c-8f76-c2419bd6c715 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:48.346804 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-0ddc1527-eb2f-472c-8f76-c2419bd6c715 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:48.353861 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0ddc1527-eb2f-472c-8f76-c2419bd6c715 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:48.354585 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0ddc1527-eb2f-472c-8f76-c2419bd6c715 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:48.356536 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0ddc1527-eb2f-472c-8f76-c2419bd6c715 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:48.357129 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0ddc1527-eb2f-472c-8f76-c2419bd6c715 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:48.565266 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0ddc1527-eb2f-472c-8f76-c2419bd6c715 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:48.573826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0ddc1527-eb2f-472c-8f76-c2419bd6c715 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:48.575386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0ddc1527-eb2f-472c-8f76-c2419bd6c715 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:48.576570 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-0ddc1527-eb2f-472c-8f76-c2419bd6c715 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1740 microversion: 2.20 time: 0.237626 May 11 07:43:48.577133 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 310/619] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:48 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:49.598805 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ef2e2acc-0491-42fb-bcda-31bbd0ae9069 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:49.600469 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ef2e2acc-0491-42fb-bcda-31bbd0ae9069 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:49.607242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef2e2acc-0491-42fb-bcda-31bbd0ae9069 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:49.607812 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef2e2acc-0491-42fb-bcda-31bbd0ae9069 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:49.611131 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef2e2acc-0491-42fb-bcda-31bbd0ae9069 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:49.613434 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef2e2acc-0491-42fb-bcda-31bbd0ae9069 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:49.791125 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ef2e2acc-0491-42fb-bcda-31bbd0ae9069 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:49.799728 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ef2e2acc-0491-42fb-bcda-31bbd0ae9069 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:49.801628 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ef2e2acc-0491-42fb-bcda-31bbd0ae9069 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:49.802897 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ef2e2acc-0491-42fb-bcda-31bbd0ae9069 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1740 microversion: 2.20 time: 0.211064 May 11 07:43:49.803733 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 310/620] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:49 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:50.371770 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-3326de54-c532-4500-9393-d523b2f749f8 req-0ea4749f-2f18-4937-9a7a-ffd08b2633c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69085008-f940-4f96-936a-e0311df279c7", "tag": "a2bb40c8-8fd7-4b35-a542-bf1d3ba6c9e4"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:50.388702 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-3326de54-c532-4500-9393-d523b2f749f8 req-0ea4749f-2f18-4937-9a7a-ffd08b2633c1 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:50.389155 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-3326de54-c532-4500-9393-d523b2f749f8 req-0ea4749f-2f18-4937-9a7a-ffd08b2633c1 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:50.402890 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-3326de54-c532-4500-9393-d523b2f749f8 req-0ea4749f-2f18-4937-9a7a-ffd08b2633c1 service nova] Creating event network-changed:a2bb40c8-8fd7-4b35-a542-bf1d3ba6c9e4 for instance 69085008-f940-4f96-936a-e0311df279c7 on hv-cinder-83699 May 11 07:43:50.408466 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-3326de54-c532-4500-9393-d523b2f749f8 req-0ea4749f-2f18-4937-9a7a-ffd08b2633c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147224 May 11 07:43:50.409588 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 311/621] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:43:50.695926 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-abd083ca-d5ea-4c71-a670-94432ba3291f req-67a1fbab-ce70-4a43-a827-a9ad9ddb4616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03c4e26-68ab-49e2-ac51-aa3bce79d3e7", "name": "network-vif-plugged", "status": "completed", "tag": "c341b877-b342-4956-94f6-3c4bcad3497f"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:43:50.708715 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-abd083ca-d5ea-4c71-a670-94432ba3291f req-67a1fbab-ce70-4a43-a827-a9ad9ddb4616 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:50.709614 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-abd083ca-d5ea-4c71-a670-94432ba3291f req-67a1fbab-ce70-4a43-a827-a9ad9ddb4616 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:50.732185 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-abd083ca-d5ea-4c71-a670-94432ba3291f req-67a1fbab-ce70-4a43-a827-a9ad9ddb4616 service nova] Creating event network-vif-plugged:c341b877-b342-4956-94f6-3c4bcad3497f for instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 on hv-cinder-83699 May 11 07:43:50.737736 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-abd083ca-d5ea-4c71-a670-94432ba3291f req-67a1fbab-ce70-4a43-a827-a9ad9ddb4616 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053802 May 11 07:43:50.738866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 311/622] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:43:50.825024 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-159ebf68-4130-4962-99d9-e99064465651 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:50.825749 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-159ebf68-4130-4962-99d9-e99064465651 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:50.842063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-159ebf68-4130-4962-99d9-e99064465651 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:50.844074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-159ebf68-4130-4962-99d9-e99064465651 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:50.845042 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-159ebf68-4130-4962-99d9-e99064465651 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:50.846134 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-159ebf68-4130-4962-99d9-e99064465651 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:51.029164 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-159ebf68-4130-4962-99d9-e99064465651 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:51.037954 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-159ebf68-4130-4962-99d9-e99064465651 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:51.050432 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-159ebf68-4130-4962-99d9-e99064465651 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:51.052203 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-159ebf68-4130-4962-99d9-e99064465651 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1740 microversion: 2.20 time: 0.233919 May 11 07:43:51.063356 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 312/623] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:50 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:52.072537 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-8484dca5-61ac-47bd-a713-e18ab947183a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:52.073129 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-8484dca5-61ac-47bd-a713-e18ab947183a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:52.082070 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8484dca5-61ac-47bd-a713-e18ab947183a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:52.083188 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8484dca5-61ac-47bd-a713-e18ab947183a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:52.083963 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8484dca5-61ac-47bd-a713-e18ab947183a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:52.084392 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8484dca5-61ac-47bd-a713-e18ab947183a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:52.234016 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-8484dca5-61ac-47bd-a713-e18ab947183a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:52.242776 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-8484dca5-61ac-47bd-a713-e18ab947183a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:52.245871 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-8484dca5-61ac-47bd-a713-e18ab947183a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:52.248277 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-8484dca5-61ac-47bd-a713-e18ab947183a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1740 microversion: 2.20 time: 0.180170 May 11 07:43:52.248848 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 312/624] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:52 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:53.269010 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-bff6008d-afe2-4cdc-b4bd-34b39ba4378a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:53.269662 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-bff6008d-afe2-4cdc-b4bd-34b39ba4378a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:53.281735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bff6008d-afe2-4cdc-b4bd-34b39ba4378a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:53.282356 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bff6008d-afe2-4cdc-b4bd-34b39ba4378a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:53.283309 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bff6008d-afe2-4cdc-b4bd-34b39ba4378a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:53.284077 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bff6008d-afe2-4cdc-b4bd-34b39ba4378a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:53.455990 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-bff6008d-afe2-4cdc-b4bd-34b39ba4378a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:53.467621 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-bff6008d-afe2-4cdc-b4bd-34b39ba4378a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:53.469144 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-bff6008d-afe2-4cdc-b4bd-34b39ba4378a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:53.470328 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-bff6008d-afe2-4cdc-b4bd-34b39ba4378a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1740 microversion: 2.20 time: 0.206183 May 11 07:43:53.470897 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 313/625] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:53 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:54.499392 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-278686f7-b45a-47e6-a6a3-2eebd7490944 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:54.500632 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-278686f7-b45a-47e6-a6a3-2eebd7490944 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:54.509474 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-278686f7-b45a-47e6-a6a3-2eebd7490944 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:54.510879 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-278686f7-b45a-47e6-a6a3-2eebd7490944 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:54.512084 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-278686f7-b45a-47e6-a6a3-2eebd7490944 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:54.512752 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-278686f7-b45a-47e6-a6a3-2eebd7490944 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:54.655138 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-278686f7-b45a-47e6-a6a3-2eebd7490944 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:54.663528 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-278686f7-b45a-47e6-a6a3-2eebd7490944 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:54.665116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-278686f7-b45a-47e6-a6a3-2eebd7490944 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:54.666514 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-278686f7-b45a-47e6-a6a3-2eebd7490944 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1740 microversion: 2.20 time: 0.175861 May 11 07:43:54.667191 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 313/626] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:54 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:55.687481 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-16b6f474-735d-4320-b599-d6267b3adfe4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:55.688309 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-16b6f474-735d-4320-b599-d6267b3adfe4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:55.696183 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-16b6f474-735d-4320-b599-d6267b3adfe4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:55.698035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-16b6f474-735d-4320-b599-d6267b3adfe4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:55.703443 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-16b6f474-735d-4320-b599-d6267b3adfe4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:55.704252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-16b6f474-735d-4320-b599-d6267b3adfe4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:55.883263 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-16b6f474-735d-4320-b599-d6267b3adfe4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:55.895512 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-16b6f474-735d-4320-b599-d6267b3adfe4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:55.897325 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-16b6f474-735d-4320-b599-d6267b3adfe4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:55.898718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-16b6f474-735d-4320-b599-d6267b3adfe4 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1740 microversion: 2.20 time: 0.215973 May 11 07:43:55.899762 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 314/627] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:55 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:56.916119 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b9737ef9-b70b-4365-bf07-66017468ba16 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:56.916820 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-b9737ef9-b70b-4365-bf07-66017468ba16 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:56.924222 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b9737ef9-b70b-4365-bf07-66017468ba16 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:56.924665 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b9737ef9-b70b-4365-bf07-66017468ba16 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:56.925425 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b9737ef9-b70b-4365-bf07-66017468ba16 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:56.925889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b9737ef9-b70b-4365-bf07-66017468ba16 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:57.055363 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-b9737ef9-b70b-4365-bf07-66017468ba16 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:57.062973 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-b9737ef9-b70b-4365-bf07-66017468ba16 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:57.064459 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-b9737ef9-b70b-4365-bf07-66017468ba16 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:57.065622 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-b9737ef9-b70b-4365-bf07-66017468ba16 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1740 microversion: 2.20 time: 0.153414 May 11 07:43:57.066432 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 314/628] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:56 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:58.083855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f07fa1f5-4b72-4e9b-8de1-3a629ce0c91e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:58.084483 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f07fa1f5-4b72-4e9b-8de1-3a629ce0c91e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:58.090727 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f07fa1f5-4b72-4e9b-8de1-3a629ce0c91e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:58.091177 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f07fa1f5-4b72-4e9b-8de1-3a629ce0c91e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:58.091932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f07fa1f5-4b72-4e9b-8de1-3a629ce0c91e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:58.092369 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f07fa1f5-4b72-4e9b-8de1-3a629ce0c91e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:58.216996 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f07fa1f5-4b72-4e9b-8de1-3a629ce0c91e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:58.225042 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f07fa1f5-4b72-4e9b-8de1-3a629ce0c91e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:58.226585 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f07fa1f5-4b72-4e9b-8de1-3a629ce0c91e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:58.227718 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f07fa1f5-4b72-4e9b-8de1-3a629ce0c91e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1722 microversion: 2.20 time: 0.147705 May 11 07:43:58.228265 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 315/629] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:58 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:43:59.245691 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3081eced-23b5-480f-a9b5-dba0c193c6dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:43:59.246790 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-3081eced-23b5-480f-a9b5-dba0c193c6dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:43:59.252991 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3081eced-23b5-480f-a9b5-dba0c193c6dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:59.253429 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3081eced-23b5-480f-a9b5-dba0c193c6dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:59.254206 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3081eced-23b5-480f-a9b5-dba0c193c6dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:43:59.254635 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3081eced-23b5-480f-a9b5-dba0c193c6dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:43:59.384153 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-3081eced-23b5-480f-a9b5-dba0c193c6dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:59.391748 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-3081eced-23b5-480f-a9b5-dba0c193c6dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:59.393287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-3081eced-23b5-480f-a9b5-dba0c193c6dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:43:59.394447 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-3081eced-23b5-480f-a9b5-dba0c193c6dc tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1722 microversion: 2.20 time: 0.152680 May 11 07:43:59.395000 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 315/630] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:43:59 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:00.412211 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9ca09551-5faa-4303-9099-3c8d63260055 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:00.412814 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9ca09551-5faa-4303-9099-3c8d63260055 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:00.419161 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9ca09551-5faa-4303-9099-3c8d63260055 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:00.419615 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9ca09551-5faa-4303-9099-3c8d63260055 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:00.420380 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9ca09551-5faa-4303-9099-3c8d63260055 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:00.420821 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9ca09551-5faa-4303-9099-3c8d63260055 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:00.563020 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9ca09551-5faa-4303-9099-3c8d63260055 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:00.570963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9ca09551-5faa-4303-9099-3c8d63260055 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:00.572449 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9ca09551-5faa-4303-9099-3c8d63260055 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:00.573606 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9ca09551-5faa-4303-9099-3c8d63260055 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1665 microversion: 2.20 time: 0.165251 May 11 07:44:00.574339 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 316/631] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:00 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:00.591331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c167a105-6bd4-407d-a6e1-e0cf39fab05e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60aa9772-57fe-44cf-ab9e-c368d2797102"}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:44:00.592384 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c167a105-6bd4-407d-a6e1-e0cf39fab05e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:00.598183 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c167a105-6bd4-407d-a6e1-e0cf39fab05e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:00.598664 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c167a105-6bd4-407d-a6e1-e0cf39fab05e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:00.599432 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c167a105-6bd4-407d-a6e1-e0cf39fab05e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:00.599869 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c167a105-6bd4-407d-a6e1-e0cf39fab05e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:00.654667 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-97048edb-25ac-4ec8-aa54-8f44a6810d60 req-c61436cb-e301-45b9-9f1d-36fdb8329884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03c4e26-68ab-49e2-ac51-aa3bce79d3e7", "name": "network-vif-unplugged", "status": "completed", "tag": "c341b877-b342-4956-94f6-3c4bcad3497f"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:44:00.663554 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-97048edb-25ac-4ec8-aa54-8f44a6810d60 req-c61436cb-e301-45b9-9f1d-36fdb8329884 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:00.663992 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-97048edb-25ac-4ec8-aa54-8f44a6810d60 req-c61436cb-e301-45b9-9f1d-36fdb8329884 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:00.675356 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.compute.server_external_events [req-97048edb-25ac-4ec8-aa54-8f44a6810d60 req-c61436cb-e301-45b9-9f1d-36fdb8329884 service nova] Unable to find a host for instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7. Dropping event network-vif-unplugged {{(pid=123599) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 11 07:44:00.676214 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-97048edb-25ac-4ec8-aa54-8f44a6810d60 req-c61436cb-e301-45b9-9f1d-36fdb8329884 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.209334 May 11 07:44:00.676782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 316/632] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 210 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 11 07:44:00.855335 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c167a105-6bd4-407d-a6e1-e0cf39fab05e tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "POST /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.267892 May 11 07:44:00.856526 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 317/633] 10.222.0.36 () {62 vars in 1363 bytes} [Wed May 11 07:44:00 2022] POST /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7/os-volume_attachments => generated 188 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 07:44:00.964803 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-cda674e3-028f-455e-9c6a-b1a0efa9af09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:00.965318 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-cda674e3-028f-455e-9c6a-b1a0efa9af09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:00.971126 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cda674e3-028f-455e-9c6a-b1a0efa9af09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:00.971569 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cda674e3-028f-455e-9c6a-b1a0efa9af09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:00.972352 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cda674e3-028f-455e-9c6a-b1a0efa9af09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:00.972785 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cda674e3-028f-455e-9c6a-b1a0efa9af09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:01.197968 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-cda674e3-028f-455e-9c6a-b1a0efa9af09 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7/os-volume_attachments/60aa9772-57fe-44cf-ab9e-c368d2797102" status: 202 len: 0 microversion: 2.20 time: 0.237251 May 11 07:44:01.198544 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 317/634] 10.222.0.36 () {60 vars in 1456 bytes} [Wed May 11 07:44:00 2022] DELETE /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7/os-volume_attachments/60aa9772-57fe-44cf-ab9e-c368d2797102 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 11 07:44:01.252961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f3a63f5e-3036-4c73-b80a-7c66604019fd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:44:01.253525 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f3a63f5e-3036-4c73-b80a-7c66604019fd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:01.259346 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f3a63f5e-3036-4c73-b80a-7c66604019fd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:01.259795 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f3a63f5e-3036-4c73-b80a-7c66604019fd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:01.260553 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f3a63f5e-3036-4c73-b80a-7c66604019fd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:01.260991 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f3a63f5e-3036-4c73-b80a-7c66604019fd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:01.439394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f3a63f5e-3036-4c73-b80a-7c66604019fd tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "POST /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7/action" status: 202 len: 0 microversion: 2.20 time: 0.190259 May 11 07:44:01.440073 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 318/635] 10.222.0.36 () {62 vars in 1318 bytes} [Wed May 11 07:44:01 2022] POST /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 07:44:01.448338 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-700708fb-07d2-4eed-90cb-773bee9189cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:01.448939 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-700708fb-07d2-4eed-90cb-773bee9189cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:01.455475 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-700708fb-07d2-4eed-90cb-773bee9189cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:01.455926 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-700708fb-07d2-4eed-90cb-773bee9189cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:01.456692 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-700708fb-07d2-4eed-90cb-773bee9189cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:01.457120 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-700708fb-07d2-4eed-90cb-773bee9189cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:01.583859 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-700708fb-07d2-4eed-90cb-773bee9189cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:01.592420 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-700708fb-07d2-4eed-90cb-773bee9189cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:01.593954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-700708fb-07d2-4eed-90cb-773bee9189cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:01.595105 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-700708fb-07d2-4eed-90cb-773bee9189cf tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1673 microversion: 2.20 time: 0.150620 May 11 07:44:01.595712 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 318/636] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:01 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:02.614190 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-923ea4c9-9db2-4cc8-9826-82232815ab2f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:02.614751 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-923ea4c9-9db2-4cc8-9826-82232815ab2f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:02.622092 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-923ea4c9-9db2-4cc8-9826-82232815ab2f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:02.622547 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-923ea4c9-9db2-4cc8-9826-82232815ab2f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:02.623318 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-923ea4c9-9db2-4cc8-9826-82232815ab2f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:02.623757 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-923ea4c9-9db2-4cc8-9826-82232815ab2f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:02.752469 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-923ea4c9-9db2-4cc8-9826-82232815ab2f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:02.760381 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-923ea4c9-9db2-4cc8-9826-82232815ab2f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:02.761948 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-923ea4c9-9db2-4cc8-9826-82232815ab2f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:02.763090 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-923ea4c9-9db2-4cc8-9826-82232815ab2f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1731 microversion: 2.20 time: 0.153461 May 11 07:44:02.763641 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 319/637] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:02 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:03.781288 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6b487629-f70a-493a-858c-17dda1da2229 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:03.782004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-6b487629-f70a-493a-858c-17dda1da2229 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:03.789169 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6b487629-f70a-493a-858c-17dda1da2229 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:03.789750 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6b487629-f70a-493a-858c-17dda1da2229 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:03.790617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6b487629-f70a-493a-858c-17dda1da2229 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:03.791125 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6b487629-f70a-493a-858c-17dda1da2229 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:03.932327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-6b487629-f70a-493a-858c-17dda1da2229 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:03.942146 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-6b487629-f70a-493a-858c-17dda1da2229 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:03.945224 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-6b487629-f70a-493a-858c-17dda1da2229 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:03.946867 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-6b487629-f70a-493a-858c-17dda1da2229 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1731 microversion: 2.20 time: 0.169441 May 11 07:44:03.947950 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 319/638] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:03 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:04.967679 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4b239437-139a-4fbb-ad01-91119f774e38 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:04.968320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4b239437-139a-4fbb-ad01-91119f774e38 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:04.974468 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4b239437-139a-4fbb-ad01-91119f774e38 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:04.974918 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4b239437-139a-4fbb-ad01-91119f774e38 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:04.975737 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4b239437-139a-4fbb-ad01-91119f774e38 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:04.976173 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4b239437-139a-4fbb-ad01-91119f774e38 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:05.116513 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4b239437-139a-4fbb-ad01-91119f774e38 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:05.125628 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4b239437-139a-4fbb-ad01-91119f774e38 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:05.127363 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4b239437-139a-4fbb-ad01-91119f774e38 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:05.128531 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4b239437-139a-4fbb-ad01-91119f774e38 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1731 microversion: 2.20 time: 0.166292 May 11 07:44:05.129140 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 320/639] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:04 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:06.147684 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-56c614d0-b20e-467e-b1ef-7ae0846efc67 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:06.148295 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-56c614d0-b20e-467e-b1ef-7ae0846efc67 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:06.155537 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-56c614d0-b20e-467e-b1ef-7ae0846efc67 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:06.155989 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-56c614d0-b20e-467e-b1ef-7ae0846efc67 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:06.156771 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-56c614d0-b20e-467e-b1ef-7ae0846efc67 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:06.157212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-56c614d0-b20e-467e-b1ef-7ae0846efc67 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:06.291283 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-56c614d0-b20e-467e-b1ef-7ae0846efc67 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:06.299221 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-56c614d0-b20e-467e-b1ef-7ae0846efc67 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:06.300741 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-56c614d0-b20e-467e-b1ef-7ae0846efc67 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:06.301987 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-56c614d0-b20e-467e-b1ef-7ae0846efc67 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1731 microversion: 2.20 time: 0.158118 May 11 07:44:06.302674 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 320/640] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:06 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:07.320499 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c7325311-56f7-476f-9602-d65c47f5eb20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:07.321245 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c7325311-56f7-476f-9602-d65c47f5eb20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:07.327802 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c7325311-56f7-476f-9602-d65c47f5eb20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:07.328335 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c7325311-56f7-476f-9602-d65c47f5eb20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:07.329182 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c7325311-56f7-476f-9602-d65c47f5eb20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:07.329724 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c7325311-56f7-476f-9602-d65c47f5eb20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:07.464671 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c7325311-56f7-476f-9602-d65c47f5eb20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:07.473156 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c7325311-56f7-476f-9602-d65c47f5eb20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:07.485058 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c7325311-56f7-476f-9602-d65c47f5eb20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:07.485058 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c7325311-56f7-476f-9602-d65c47f5eb20 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1731 microversion: 2.20 time: 0.159317 May 11 07:44:07.485058 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 321/641] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:07 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:08.373038 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-34c98809-be07-42a1-aad7-f96d69209747 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:08.373778 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-34c98809-be07-42a1-aad7-f96d69209747 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:08.383194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-34c98809-be07-42a1-aad7-f96d69209747 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:08.383680 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-34c98809-be07-42a1-aad7-f96d69209747 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:08.384467 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-34c98809-be07-42a1-aad7-f96d69209747 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:08.384902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-34c98809-be07-42a1-aad7-f96d69209747 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:08.412552 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-34c98809-be07-42a1-aad7-f96d69209747 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/ips" status: 200 len: 145 microversion: 2.1 time: 0.043545 May 11 07:44:08.413125 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 321/642] 10.222.0.36 () {58 vars in 1247 bytes} [Wed May 11 07:44:08 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:08.494626 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-fcc0a2c4-8f8c-4b84-bc8e-3d5e2f6b820a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:08.495298 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-fcc0a2c4-8f8c-4b84-bc8e-3d5e2f6b820a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:08.502372 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fcc0a2c4-8f8c-4b84-bc8e-3d5e2f6b820a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:08.502821 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fcc0a2c4-8f8c-4b84-bc8e-3d5e2f6b820a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:08.503595 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fcc0a2c4-8f8c-4b84-bc8e-3d5e2f6b820a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:08.504029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fcc0a2c4-8f8c-4b84-bc8e-3d5e2f6b820a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:08.657792 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-fcc0a2c4-8f8c-4b84-bc8e-3d5e2f6b820a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:08.665634 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-fcc0a2c4-8f8c-4b84-bc8e-3d5e2f6b820a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:08.666992 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-fcc0a2c4-8f8c-4b84-bc8e-3d5e2f6b820a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:08.668172 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-fcc0a2c4-8f8c-4b84-bc8e-3d5e2f6b820a tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1731 microversion: 2.20 time: 0.177415 May 11 07:44:08.669029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 322/643] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:08 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:09.687523 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ef5a70e6-23d5-4a79-9587-406cee6dff69 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:09.688246 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ef5a70e6-23d5-4a79-9587-406cee6dff69 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:09.697099 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef5a70e6-23d5-4a79-9587-406cee6dff69 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:09.697570 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef5a70e6-23d5-4a79-9587-406cee6dff69 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:09.698402 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef5a70e6-23d5-4a79-9587-406cee6dff69 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:09.698841 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef5a70e6-23d5-4a79-9587-406cee6dff69 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:09.772654 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ee0ead0c-8719-4424-be8c-43c7b898bc2f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f78c4794-d0a3-4795-859f-8e7ea4680525"}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:44:09.774139 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-ee0ead0c-8719-4424-be8c-43c7b898bc2f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:09.785635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ee0ead0c-8719-4424-be8c-43c7b898bc2f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:09.786093 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ee0ead0c-8719-4424-be8c-43c7b898bc2f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:09.787065 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ee0ead0c-8719-4424-be8c-43c7b898bc2f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:09.787729 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ee0ead0c-8719-4424-be8c-43c7b898bc2f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:09.875367 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ef5a70e6-23d5-4a79-9587-406cee6dff69 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:09.884681 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ef5a70e6-23d5-4a79-9587-406cee6dff69 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:09.886522 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ef5a70e6-23d5-4a79-9587-406cee6dff69 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:09.887910 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ef5a70e6-23d5-4a79-9587-406cee6dff69 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1731 microversion: 2.20 time: 0.204784 May 11 07:44:09.888721 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 322/644] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:09 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:10.907074 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-35faa04f-fb89-4802-928a-3be996c44c56 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:10.907756 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-35faa04f-fb89-4802-928a-3be996c44c56 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:10.915273 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-35faa04f-fb89-4802-928a-3be996c44c56 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:10.915730 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-35faa04f-fb89-4802-928a-3be996c44c56 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:10.916517 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-35faa04f-fb89-4802-928a-3be996c44c56 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:10.916957 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-35faa04f-fb89-4802-928a-3be996c44c56 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:11.051196 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-35faa04f-fb89-4802-928a-3be996c44c56 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:11.075489 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-35faa04f-fb89-4802-928a-3be996c44c56 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:11.077612 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-35faa04f-fb89-4802-928a-3be996c44c56 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:11.078892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-35faa04f-fb89-4802-928a-3be996c44c56 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1731 microversion: 2.20 time: 0.176420 May 11 07:44:11.079634 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 323/645] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:10 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 07:44:12.096234 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ebb6ffff-13b6-4739-9163-b1dc8f493cd8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:12.096933 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ebb6ffff-13b6-4739-9163-b1dc8f493cd8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:12.103149 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ebb6ffff-13b6-4739-9163-b1dc8f493cd8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:12.103594 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ebb6ffff-13b6-4739-9163-b1dc8f493cd8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:12.104549 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ebb6ffff-13b6-4739-9163-b1dc8f493cd8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:12.104979 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ebb6ffff-13b6-4739-9163-b1dc8f493cd8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:12.251311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ebb6ffff-13b6-4739-9163-b1dc8f493cd8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:12.259441 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ebb6ffff-13b6-4739-9163-b1dc8f493cd8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:12.260978 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ebb6ffff-13b6-4739-9163-b1dc8f493cd8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:12.262165 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ebb6ffff-13b6-4739-9163-b1dc8f493cd8 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1731 microversion: 2.20 time: 0.169801 May 11 07:44:12.262729 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 324/646] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:12 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 07:44:13.281577 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0a6413cd-c4f3-4c90-ac5c-414c29661b81 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:13.282222 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0a6413cd-c4f3-4c90-ac5c-414c29661b81 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:13.288430 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0a6413cd-c4f3-4c90-ac5c-414c29661b81 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:13.288879 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0a6413cd-c4f3-4c90-ac5c-414c29661b81 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:13.289677 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0a6413cd-c4f3-4c90-ac5c-414c29661b81 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:13.290110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0a6413cd-c4f3-4c90-ac5c-414c29661b81 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:13.414422 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0a6413cd-c4f3-4c90-ac5c-414c29661b81 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:13.422559 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0a6413cd-c4f3-4c90-ac5c-414c29661b81 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:13.424047 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0a6413cd-c4f3-4c90-ac5c-414c29661b81 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:13.425187 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0a6413cd-c4f3-4c90-ac5c-414c29661b81 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1731 microversion: 2.20 time: 0.148851 May 11 07:44:13.425770 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 325/647] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:13 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 07:44:14.065644 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-ee0ead0c-8719-4424-be8c-43c7b898bc2f tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "POST /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.297201 May 11 07:44:14.066654 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 323/648] 10.222.0.36 () {60 vars in 1322 bytes} [Wed May 11 07:44:09 2022] POST /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments => generated 194 bytes in 4299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:14.442926 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ed5e4ca4-0ef3-4486-84bb-a14cda4cd05b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:14.443581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ed5e4ca4-0ef3-4486-84bb-a14cda4cd05b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:14.450749 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ed5e4ca4-0ef3-4486-84bb-a14cda4cd05b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:14.451272 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ed5e4ca4-0ef3-4486-84bb-a14cda4cd05b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:14.452058 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ed5e4ca4-0ef3-4486-84bb-a14cda4cd05b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:14.452496 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ed5e4ca4-0ef3-4486-84bb-a14cda4cd05b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:14.589812 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ed5e4ca4-0ef3-4486-84bb-a14cda4cd05b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:14.598604 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ed5e4ca4-0ef3-4486-84bb-a14cda4cd05b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:14.600092 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ed5e4ca4-0ef3-4486-84bb-a14cda4cd05b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:14.601240 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ed5e4ca4-0ef3-4486-84bb-a14cda4cd05b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1731 microversion: 2.20 time: 0.162657 May 11 07:44:14.601825 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 326/649] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:14 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:15.621467 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b57ea3b9-c2cc-4924-a82e-ddc8b5606c91 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:15.622209 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-b57ea3b9-c2cc-4924-a82e-ddc8b5606c91 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:15.628862 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b57ea3b9-c2cc-4924-a82e-ddc8b5606c91 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:15.629317 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b57ea3b9-c2cc-4924-a82e-ddc8b5606c91 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:15.630124 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b57ea3b9-c2cc-4924-a82e-ddc8b5606c91 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:15.630572 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b57ea3b9-c2cc-4924-a82e-ddc8b5606c91 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:15.754332 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-b57ea3b9-c2cc-4924-a82e-ddc8b5606c91 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:15.761939 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-b57ea3b9-c2cc-4924-a82e-ddc8b5606c91 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:15.764050 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-b57ea3b9-c2cc-4924-a82e-ddc8b5606c91 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:15.765190 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-b57ea3b9-c2cc-4924-a82e-ddc8b5606c91 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1731 microversion: 2.20 time: 0.148446 May 11 07:44:15.765791 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 324/650] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:15 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:16.543987 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-90f3f589-d122-47a8-95ea-b19d3ef8c9de req-e40b62e1-c066-479f-92bf-3206cfcf5ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03c4e26-68ab-49e2-ac51-aa3bce79d3e7", "name": "network-vif-plugged", "status": "completed", "tag": "c341b877-b342-4956-94f6-3c4bcad3497f"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:44:16.552974 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-90f3f589-d122-47a8-95ea-b19d3ef8c9de req-e40b62e1-c066-479f-92bf-3206cfcf5ee8 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:16.553495 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-90f3f589-d122-47a8-95ea-b19d3ef8c9de req-e40b62e1-c066-479f-92bf-3206cfcf5ee8 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:16.564470 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-90f3f589-d122-47a8-95ea-b19d3ef8c9de req-e40b62e1-c066-479f-92bf-3206cfcf5ee8 service nova] Creating event network-vif-plugged:c341b877-b342-4956-94f6-3c4bcad3497f for instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 on hv-cinder-83699 May 11 07:44:16.569748 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-90f3f589-d122-47a8-95ea-b19d3ef8c9de req-e40b62e1-c066-479f-92bf-3206cfcf5ee8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029336 May 11 07:44:16.570337 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 327/651] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:16.784323 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-20e36e71-2b22-4d21-aa08-bfe2e228329b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:16.785567 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-20e36e71-2b22-4d21-aa08-bfe2e228329b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:16.793512 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-20e36e71-2b22-4d21-aa08-bfe2e228329b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:16.794242 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-20e36e71-2b22-4d21-aa08-bfe2e228329b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:16.795222 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-20e36e71-2b22-4d21-aa08-bfe2e228329b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:16.795843 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-20e36e71-2b22-4d21-aa08-bfe2e228329b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:16.925846 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-20e36e71-2b22-4d21-aa08-bfe2e228329b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:16.933967 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-20e36e71-2b22-4d21-aa08-bfe2e228329b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:16.936185 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-20e36e71-2b22-4d21-aa08-bfe2e228329b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:16.937577 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-20e36e71-2b22-4d21-aa08-bfe2e228329b tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1731 microversion: 2.20 time: 0.157627 May 11 07:44:16.938530 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 325/652] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:16 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:17.956873 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-f0d4b909-d0f7-4e1d-8281-62a0f6623fa2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:17.957586 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-f0d4b909-d0f7-4e1d-8281-62a0f6623fa2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:17.964082 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f0d4b909-d0f7-4e1d-8281-62a0f6623fa2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:17.964530 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f0d4b909-d0f7-4e1d-8281-62a0f6623fa2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:17.965725 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f0d4b909-d0f7-4e1d-8281-62a0f6623fa2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:17.966436 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f0d4b909-d0f7-4e1d-8281-62a0f6623fa2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:18.110635 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-f0d4b909-d0f7-4e1d-8281-62a0f6623fa2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:18.118247 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-f0d4b909-d0f7-4e1d-8281-62a0f6623fa2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:18.119738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-f0d4b909-d0f7-4e1d-8281-62a0f6623fa2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:18.120933 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-f0d4b909-d0f7-4e1d-8281-62a0f6623fa2 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1731 microversion: 2.20 time: 0.168287 May 11 07:44:18.121489 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 328/653] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:17 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:19.139252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8ae37530-79a1-467d-b55c-259c44e2ae92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:19.139858 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8ae37530-79a1-467d-b55c-259c44e2ae92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:19.146190 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8ae37530-79a1-467d-b55c-259c44e2ae92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:19.146647 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8ae37530-79a1-467d-b55c-259c44e2ae92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:19.147416 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8ae37530-79a1-467d-b55c-259c44e2ae92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:19.147859 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8ae37530-79a1-467d-b55c-259c44e2ae92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:19.273214 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8ae37530-79a1-467d-b55c-259c44e2ae92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:19.281386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8ae37530-79a1-467d-b55c-259c44e2ae92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:19.282898 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8ae37530-79a1-467d-b55c-259c44e2ae92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:19.284040 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8ae37530-79a1-467d-b55c-259c44e2ae92 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1718 microversion: 2.20 time: 0.148687 May 11 07:44:19.284600 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 326/654] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:19 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:21.529777 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3c20336a-4146-420a-9281-1d78f9403e9c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:21.530690 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-3c20336a-4146-420a-9281-1d78f9403e9c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:21.536901 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3c20336a-4146-420a-9281-1d78f9403e9c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:21.537347 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3c20336a-4146-420a-9281-1d78f9403e9c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:21.538130 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3c20336a-4146-420a-9281-1d78f9403e9c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:21.538560 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3c20336a-4146-420a-9281-1d78f9403e9c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:21.566676 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-3c20336a-4146-420a-9281-1d78f9403e9c tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040977 May 11 07:44:21.567208 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 329/655] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:44:21 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:21.577499 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4880a629-be36-4faa-acc3-969f3e0002b9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:21.578064 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4880a629-be36-4faa-acc3-969f3e0002b9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:21.584566 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4880a629-be36-4faa-acc3-969f3e0002b9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:21.585042 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4880a629-be36-4faa-acc3-969f3e0002b9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:21.585835 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4880a629-be36-4faa-acc3-969f3e0002b9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:21.586296 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4880a629-be36-4faa-acc3-969f3e0002b9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:21.613042 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4880a629-be36-4faa-acc3-969f3e0002b9 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments/f78c4794-d0a3-4795-859f-8e7ea4680525" status: 200 len: 194 microversion: 2.1 time: 0.039927 May 11 07:44:21.613509 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 327/656] 10.222.0.36 () {58 vars in 1412 bytes} [Wed May 11 07:44:21 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments/f78c4794-d0a3-4795-859f-8e7ea4680525 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:22.911347 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6fc7f88f-51f8-4bd7-9b00-8a996a4637c5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc9c9ebe-9c24-47b2-baf3-e6c5a5df1ade"}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:44:22.912447 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-6fc7f88f-51f8-4bd7-9b00-8a996a4637c5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:22.918701 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6fc7f88f-51f8-4bd7-9b00-8a996a4637c5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:22.919145 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6fc7f88f-51f8-4bd7-9b00-8a996a4637c5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:22.919943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6fc7f88f-51f8-4bd7-9b00-8a996a4637c5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:22.920374 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-6fc7f88f-51f8-4bd7-9b00-8a996a4637c5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:23.149061 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-6fc7f88f-51f8-4bd7-9b00-8a996a4637c5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "POST /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241448 May 11 07:44:23.149698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 330/657] 10.222.0.36 () {60 vars in 1322 bytes} [Wed May 11 07:44:22 2022] POST /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments => generated 194 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:28.464555 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-cb3e5679-b949-4e5d-9f21-9cac2f440fa1 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2033099877"}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:44:28.465069 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-cb3e5679-b949-4e5d-9f21-9cac2f440fa1 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:28.471884 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cb3e5679-b949-4e5d-9f21-9cac2f440fa1 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:28.472333 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cb3e5679-b949-4e5d-9f21-9cac2f440fa1 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:28.473095 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cb3e5679-b949-4e5d-9f21-9cac2f440fa1 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:28.473531 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cb3e5679-b949-4e5d-9f21-9cac2f440fa1 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:28.599517 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.network.security_group_api [None req-cb3e5679-b949-4e5d-9f21-9cac2f440fa1 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Removing security group b26c7b67-563f-44f3-bb13-d8765d1c9aa9 from port 2986b04c-bb85-422f-a436-abb58852a5fc May 11 07:44:28.977279 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-cb3e5679-b949-4e5d-9f21-9cac2f440fa1 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "POST /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/action" status: 202 len: 0 microversion: 2.1 time: 0.516487 May 11 07:44:28.977944 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 328/658] 10.222.0.36 () {60 vars in 1277 bytes} [Wed May 11 07:44:28 2022] POST /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:44:29.087902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-40b6aed0-594d-47ef-864d-26d2afedee51 req-483951df-acdd-40b0-b0c2-0214a6bc040a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5d5c60-3790-4889-92a4-0bd325a22b43", "tag": "2986b04c-bb85-422f-a436-abb58852a5fc"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:44:29.098193 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-40b6aed0-594d-47ef-864d-26d2afedee51 req-483951df-acdd-40b0-b0c2-0214a6bc040a service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:29.098953 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-40b6aed0-594d-47ef-864d-26d2afedee51 req-483951df-acdd-40b0-b0c2-0214a6bc040a service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:29.111294 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-40b6aed0-594d-47ef-864d-26d2afedee51 req-483951df-acdd-40b0-b0c2-0214a6bc040a service nova] Creating event network-changed:2986b04c-bb85-422f-a436-abb58852a5fc for instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 on hv-cinder-83699 May 11 07:44:29.135003 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-40b6aed0-594d-47ef-864d-26d2afedee51 req-483951df-acdd-40b0-b0c2-0214a6bc040a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143565 May 11 07:44:29.137810 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 331/659] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:30.608443 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2bef019f-8023-4ddf-8bea-a96f3900a0c0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:30.609715 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2bef019f-8023-4ddf-8bea-a96f3900a0c0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:30.615795 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2bef019f-8023-4ddf-8bea-a96f3900a0c0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:30.616242 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2bef019f-8023-4ddf-8bea-a96f3900a0c0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:30.617035 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2bef019f-8023-4ddf-8bea-a96f3900a0c0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:30.617466 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2bef019f-8023-4ddf-8bea-a96f3900a0c0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:30.720953 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.objects.instance [None req-2bef019f-8023-4ddf-8bea-a96f3900a0c0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lazy-loading 'services' on Instance uuid 5b5d5c60-3790-4889-92a4-0bd325a22b43 {{(pid=123600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:44:30.786194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-bbf8d73b-9af0-4058-8d5a-ff38bbab2414 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:30.787334 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-bbf8d73b-9af0-4058-8d5a-ff38bbab2414 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:30.795492 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bbf8d73b-9af0-4058-8d5a-ff38bbab2414 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:30.796097 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bbf8d73b-9af0-4058-8d5a-ff38bbab2414 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:30.797249 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bbf8d73b-9af0-4058-8d5a-ff38bbab2414 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:30.797725 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bbf8d73b-9af0-4058-8d5a-ff38bbab2414 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:30.813339 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2bef019f-8023-4ddf-8bea-a96f3900a0c0 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/os-volume_attachments/d377314e-619c-4561-98b4-a5ad42bec256" status: 202 len: 0 microversion: 2.1 time: 0.208697 May 11 07:44:30.818424 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 329/660] 10.222.0.36 () {58 vars in 1415 bytes} [Wed May 11 07:44:30 2022] DELETE /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/os-volume_attachments/d377314e-619c-4561-98b4-a5ad42bec256 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:44:30.825706 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-0166bb38-dd48-4391-b58d-5bd2998a0c6e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:30.827292 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-0166bb38-dd48-4391-b58d-5bd2998a0c6e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:30.834341 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0166bb38-dd48-4391-b58d-5bd2998a0c6e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:30.834867 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0166bb38-dd48-4391-b58d-5bd2998a0c6e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:30.835795 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0166bb38-dd48-4391-b58d-5bd2998a0c6e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:30.836329 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0166bb38-dd48-4391-b58d-5bd2998a0c6e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:30.841208 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-bbf8d73b-9af0-4058-8d5a-ff38bbab2414 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.061024 May 11 07:44:30.842539 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 332/661] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:44:30 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments => generated 371 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:44:30.878037 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-0166bb38-dd48-4391-b58d-5bd2998a0c6e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057556 May 11 07:44:30.881723 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 330/662] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:44:30 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:30.985868 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a7748859-f69b-41aa-b1ef-ced5cfdbdef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:30.986590 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a7748859-f69b-41aa-b1ef-ced5cfdbdef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:30.992572 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a7748859-f69b-41aa-b1ef-ced5cfdbdef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:30.992951 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a7748859-f69b-41aa-b1ef-ced5cfdbdef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:30.993747 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a7748859-f69b-41aa-b1ef-ced5cfdbdef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:30.994177 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a7748859-f69b-41aa-b1ef-ced5cfdbdef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:31.022953 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a7748859-f69b-41aa-b1ef-ced5cfdbdef1 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments/f78c4794-d0a3-4795-859f-8e7ea4680525" status: 200 len: 194 microversion: 2.1 time: 0.041686 May 11 07:44:31.023542 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 333/663] 10.222.0.36 () {58 vars in 1412 bytes} [Wed May 11 07:44:30 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments/f78c4794-d0a3-4795-859f-8e7ea4680525 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:31.033147 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f745f5db-2ac1-45fb-bff4-9e62ac82f3a5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:31.033660 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f745f5db-2ac1-45fb-bff4-9e62ac82f3a5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:31.039477 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f745f5db-2ac1-45fb-bff4-9e62ac82f3a5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:31.039924 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f745f5db-2ac1-45fb-bff4-9e62ac82f3a5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:31.040675 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f745f5db-2ac1-45fb-bff4-9e62ac82f3a5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:31.041116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f745f5db-2ac1-45fb-bff4-9e62ac82f3a5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:31.132671 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.objects.instance [None req-f745f5db-2ac1-45fb-bff4-9e62ac82f3a5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lazy-loading 'services' on Instance uuid 38d19445-31da-4e52-849f-b17774fef588 {{(pid=123600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:44:31.151529 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-84e544fd-901d-4569-a5a3-0d86e9f8dbfa req-406b10e4-5b5c-4fcc-ba7b-90cd914e4bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5d5c60-3790-4889-92a4-0bd325a22b43", "tag": "2986b04c-bb85-422f-a436-abb58852a5fc"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:44:31.161382 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-84e544fd-901d-4569-a5a3-0d86e9f8dbfa req-406b10e4-5b5c-4fcc-ba7b-90cd914e4bdd service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:31.161964 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-84e544fd-901d-4569-a5a3-0d86e9f8dbfa req-406b10e4-5b5c-4fcc-ba7b-90cd914e4bdd service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:31.174836 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-84e544fd-901d-4569-a5a3-0d86e9f8dbfa req-406b10e4-5b5c-4fcc-ba7b-90cd914e4bdd service nova] Creating event network-changed:2986b04c-bb85-422f-a436-abb58852a5fc for instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 on hv-cinder-83699 May 11 07:44:31.179834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-84e544fd-901d-4569-a5a3-0d86e9f8dbfa req-406b10e4-5b5c-4fcc-ba7b-90cd914e4bdd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031816 May 11 07:44:31.180496 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 334/664] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:44:31.212248 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f745f5db-2ac1-45fb-bff4-9e62ac82f3a5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "DELETE /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments/f78c4794-d0a3-4795-859f-8e7ea4680525" status: 202 len: 0 microversion: 2.1 time: 0.182844 May 11 07:44:31.213226 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 331/665] 10.222.0.36 () {58 vars in 1415 bytes} [Wed May 11 07:44:31 2022] DELETE /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments/f78c4794-d0a3-4795-859f-8e7ea4680525 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:44:31.893481 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0893c55a-9b71-41ae-a32a-71c3d23fe828 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:31.894844 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0893c55a-9b71-41ae-a32a-71c3d23fe828 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:31.901040 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0893c55a-9b71-41ae-a32a-71c3d23fe828 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:31.902121 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0893c55a-9b71-41ae-a32a-71c3d23fe828 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:31.903285 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0893c55a-9b71-41ae-a32a-71c3d23fe828 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:31.903726 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0893c55a-9b71-41ae-a32a-71c3d23fe828 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:31.934799 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0893c55a-9b71-41ae-a32a-71c3d23fe828 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047315 May 11 07:44:31.936243 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 335/666] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:44:31 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 07:44:31.947605 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9c6f4eea-4719-4022-b7b3-50e8be86b8cb tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:31.948191 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9c6f4eea-4719-4022-b7b3-50e8be86b8cb tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:31.955185 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9c6f4eea-4719-4022-b7b3-50e8be86b8cb tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:31.955639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9c6f4eea-4719-4022-b7b3-50e8be86b8cb tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:31.956432 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9c6f4eea-4719-4022-b7b3-50e8be86b8cb tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:31.956874 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9c6f4eea-4719-4022-b7b3-50e8be86b8cb tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:32.029042 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-9c6f4eea-4719-4022-b7b3-50e8be86b8cb tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] HTTP exception thrown: Instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 is not attached to volume d377314e-619c-4561-98b4-a5ad42bec256 May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9c6f4eea-4719-4022-b7b3-50e8be86b8cb tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Request method failure captured: May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: DELETE /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/os-volume_attachments/d377314e-619c-4561-98b4-a5ad42bec256 HTTP/1.1 May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2jC680NQQodVlLWrWSfC_zi2246SNH20kUYhGwqaQDjgmlRTLiwqhM2hoBcvstOWnyMEH9YCpLwuO3zTE-wsU0hYOBlT0aNv53uguyi3SqSpagvi2hEYF09v9-yIph-gbnDQ8lQ4ZV5uNQ82Xb1A5AsY1WUCI-NB5jxsBFvDKQp_YM May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 03e1fa8f24714fc9af8b0947ec51aede May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-TestMinimumBasicScenario-928645904 May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:44:32.036907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:44:32.038552 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_03e1fa8f24714fc9af8b0947ec51aede", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/03e1fa8f24714fc9af8b0947ec51aede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/03e1fa8f24714fc9af8b0947ec51aede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/03e1fa8f24714fc9af8b0947ec51aede"}]}] May 11 07:44:32.038552 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-TestMinimumBasicScenario-928645904 May 11 07:44:32.038552 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 03e1fa8f24714fc9af8b0947ec51aede May 11 07:44:32.038552 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-TestMinimumBasicScenario-928645904 May 11 07:44:32.038552 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-TestMinimumBasicScenario-928645904-project May 11 07:44:32.038552 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:44:32.038552 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:44:32.038552 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: bdcfff1647ac4569b96ad948bf991c60 May 11 07:44:32.038552 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-TestMinimumBasicScenario-928645904-project May 11 07:44:32.038552 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:44:32.038552 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 is not attached to volume d377314e-619c-4561-98b4-a5ad42bec256 May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'server_id': '5b5d5c60-3790-4889-92a4-0bd325a22b43', 'id': 'd377314e-619c-4561-98b4-a5ad42bec256'} May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d377314e-619c-4561-98b4-a5ad42bec256. May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:44:32.039386 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 is not attached to volume d377314e-619c-4561-98b4-a5ad42bec256 May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 is not attached to volume d377314e-619c-4561-98b4-a5ad42bec256 May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:32.040789 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9c6f4eea-4719-4022-b7b3-50e8be86b8cb tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Returning 404 to user: Instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 is not attached to volume d377314e-619c-4561-98b4-a5ad42bec256 {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:44:32.041913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9c6f4eea-4719-4022-b7b3-50e8be86b8cb tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/os-volume_attachments/d377314e-619c-4561-98b4-a5ad42bec256" status: 404 len: 154 microversion: 2.1 time: 0.095603 May 11 07:44:32.041913 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 332/667] 10.222.0.36 () {58 vars in 1415 bytes} [Wed May 11 07:44:31 2022] DELETE /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43/os-volume_attachments/d377314e-619c-4561-98b4-a5ad42bec256 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:44:33.168567 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-65b524e0-5402-4466-87f5-ce09cbccf97a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:33.169116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-65b524e0-5402-4466-87f5-ce09cbccf97a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:33.175363 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-65b524e0-5402-4466-87f5-ce09cbccf97a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:33.175813 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-65b524e0-5402-4466-87f5-ce09cbccf97a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:33.176574 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-65b524e0-5402-4466-87f5-ce09cbccf97a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:33.177008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-65b524e0-5402-4466-87f5-ce09cbccf97a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:33.200338 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-65b524e0-5402-4466-87f5-ce09cbccf97a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Going to try to terminate instance {{(pid=123599) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:44:33.275128 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-65b524e0-5402-4466-87f5-ce09cbccf97a tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 204 len: 0 microversion: 2.1 time: 0.109852 May 11 07:44:33.275828 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 336/668] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:44:33 2022] DELETE /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:44:33.285589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9a756031-2393-4c5d-9371-fc127bc1f210 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:33.286565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9a756031-2393-4c5d-9371-fc127bc1f210 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:33.292981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9a756031-2393-4c5d-9371-fc127bc1f210 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:33.293432 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9a756031-2393-4c5d-9371-fc127bc1f210 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:33.294230 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9a756031-2393-4c5d-9371-fc127bc1f210 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:33.294700 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9a756031-2393-4c5d-9371-fc127bc1f210 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:33.383007 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-92124a6a-a301-47a9-9536-4430bddb7390 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:33.383585 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-92124a6a-a301-47a9-9536-4430bddb7390 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:33.390149 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-92124a6a-a301-47a9-9536-4430bddb7390 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:33.390602 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-92124a6a-a301-47a9-9536-4430bddb7390 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:33.391374 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-92124a6a-a301-47a9-9536-4430bddb7390 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:33.391820 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-92124a6a-a301-47a9-9536-4430bddb7390 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:33.421420 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-92124a6a-a301-47a9-9536-4430bddb7390 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments/cc9c9ebe-9c24-47b2-baf3-e6c5a5df1ade" status: 200 len: 194 microversion: 2.1 time: 0.042645 May 11 07:44:33.422037 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 337/669] 10.222.0.36 () {58 vars in 1412 bytes} [Wed May 11 07:44:33 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments/cc9c9ebe-9c24-47b2-baf3-e6c5a5df1ade => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:44:33.422889 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9a756031-2393-4c5d-9371-fc127bc1f210 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:33.430556 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9a756031-2393-4c5d-9371-fc127bc1f210 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1556 microversion: 2.1 time: 0.149265 May 11 07:44:33.431109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 333/670] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:44:33 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:44:33.431329 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-f66c8a83-32d5-4069-b365-791a03ddedd0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:33.431750 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-f66c8a83-32d5-4069-b365-791a03ddedd0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:33.437984 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f66c8a83-32d5-4069-b365-791a03ddedd0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:33.438437 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f66c8a83-32d5-4069-b365-791a03ddedd0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:33.439209 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f66c8a83-32d5-4069-b365-791a03ddedd0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:33.439644 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f66c8a83-32d5-4069-b365-791a03ddedd0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:33.517375 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.objects.instance [None req-f66c8a83-32d5-4069-b365-791a03ddedd0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lazy-loading 'services' on Instance uuid 38d19445-31da-4e52-849f-b17774fef588 {{(pid=123599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:44:33.588545 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-f66c8a83-32d5-4069-b365-791a03ddedd0 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "DELETE /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments/cc9c9ebe-9c24-47b2-baf3-e6c5a5df1ade" status: 202 len: 0 microversion: 2.1 time: 0.160697 May 11 07:44:33.589122 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 338/671] 10.222.0.36 () {58 vars in 1415 bytes} [Wed May 11 07:44:33 2022] DELETE /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments/cc9c9ebe-9c24-47b2-baf3-e6c5a5df1ade => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 07:44:34.448473 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-cea35033-f8f8-4cf3-965e-6afd20a9f972 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:34.449084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-cea35033-f8f8-4cf3-965e-6afd20a9f972 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:34.455483 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cea35033-f8f8-4cf3-965e-6afd20a9f972 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:34.455932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cea35033-f8f8-4cf3-965e-6afd20a9f972 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:34.456700 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cea35033-f8f8-4cf3-965e-6afd20a9f972 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:34.457134 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cea35033-f8f8-4cf3-965e-6afd20a9f972 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:34.587555 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-cea35033-f8f8-4cf3-965e-6afd20a9f972 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:34.595429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-cea35033-f8f8-4cf3-965e-6afd20a9f972 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1556 microversion: 2.1 time: 0.150802 May 11 07:44:34.595985 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 334/672] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:44:34 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:44:35.613198 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-102fa49e-c022-43c3-bf51-5d49e101f8a5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:35.613921 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-102fa49e-c022-43c3-bf51-5d49e101f8a5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:35.620140 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-102fa49e-c022-43c3-bf51-5d49e101f8a5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:35.620601 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-102fa49e-c022-43c3-bf51-5d49e101f8a5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:35.621368 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-102fa49e-c022-43c3-bf51-5d49e101f8a5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:35.621848 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-102fa49e-c022-43c3-bf51-5d49e101f8a5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:35.841688 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-102fa49e-c022-43c3-bf51-5d49e101f8a5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdcfff1647ac4569b96ad948bf991c60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03e1fa8f24714fc9af8b0947ec51aede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:35.849011 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-102fa49e-c022-43c3-bf51-5d49e101f8a5 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 200 len: 1556 microversion: 2.1 time: 0.240598 May 11 07:44:35.849649 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 339/673] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:44:35 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 1556 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:44:36.095702 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-1e262ed0-da31-41d8-b734-b6a8f8a7dd16 req-6734ed0d-97d4-4389-a76e-b222879ddee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5d5c60-3790-4889-92a4-0bd325a22b43", "name": "network-vif-deleted", "tag": "2986b04c-bb85-422f-a436-abb58852a5fc"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:44:36.104908 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-1e262ed0-da31-41d8-b734-b6a8f8a7dd16 req-6734ed0d-97d4-4389-a76e-b222879ddee7 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:36.105290 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-1e262ed0-da31-41d8-b734-b6a8f8a7dd16 req-6734ed0d-97d4-4389-a76e-b222879ddee7 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:36.117001 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-1e262ed0-da31-41d8-b734-b6a8f8a7dd16 req-6734ed0d-97d4-4389-a76e-b222879ddee7 service nova] Creating event network-vif-deleted:2986b04c-bb85-422f-a436-abb58852a5fc for instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 on hv-cinder-83699 May 11 07:44:36.122219 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-1e262ed0-da31-41d8-b734-b6a8f8a7dd16 req-6734ed0d-97d4-4389-a76e-b222879ddee7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030200 May 11 07:44:36.122810 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 335/674] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:36.855820 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-533772d1-6057-45da-b9fd-cbf4642acf45 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:36.856794 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-533772d1-6057-45da-b9fd-cbf4642acf45 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:36.863193 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-533772d1-6057-45da-b9fd-cbf4642acf45 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:36.863635 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-533772d1-6057-45da-b9fd-cbf4642acf45 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:36.864391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-533772d1-6057-45da-b9fd-cbf4642acf45 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:36.864820 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-533772d1-6057-45da-b9fd-cbf4642acf45 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:36.866272 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c83b7b12-12c6-46ca-a8f6-58059a9ae14e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:36.866970 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c83b7b12-12c6-46ca-a8f6-58059a9ae14e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] [instance: 5b5d5c60-3790-4889-92a4-0bd325a22b43] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:36.872928 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c83b7b12-12c6-46ca-a8f6-58059a9ae14e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:36.873380 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c83b7b12-12c6-46ca-a8f6-58059a9ae14e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:36.874179 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c83b7b12-12c6-46ca-a8f6-58059a9ae14e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:36.874629 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c83b7b12-12c6-46ca-a8f6-58059a9ae14e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:36.887578 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-c83b7b12-12c6-46ca-a8f6-58059a9ae14e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] HTTP exception thrown: Instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 could not be found. May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c83b7b12-12c6-46ca-a8f6-58059a9ae14e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Request method failure captured: May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 HTTP/1.1 May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2jC680NQQodVlLWrWSfC_zi2246SNH20kUYhGwqaQDjgmlRTLiwqhM2hoBcvstOWnyMEH9YCpLwuO3zTE-wsU0hYOBlT0aNv53uguyi3SqSpagvi2hEYF09v9-yIph-gbnDQ8lQ4ZV5uNQ82Xb1A5AsY1WUCI-NB5jxsBFvDKQp_YM May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 03e1fa8f24714fc9af8b0947ec51aede May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-TestMinimumBasicScenario-928645904 May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:44:36.889697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:44:36.891221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_03e1fa8f24714fc9af8b0947ec51aede", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/03e1fa8f24714fc9af8b0947ec51aede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/03e1fa8f24714fc9af8b0947ec51aede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/03e1fa8f24714fc9af8b0947ec51aede"}]}] May 11 07:44:36.891221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-TestMinimumBasicScenario-928645904 May 11 07:44:36.891221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 03e1fa8f24714fc9af8b0947ec51aede May 11 07:44:36.891221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-TestMinimumBasicScenario-928645904 May 11 07:44:36.891221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-TestMinimumBasicScenario-928645904-project May 11 07:44:36.891221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:44:36.891221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:44:36.891221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: bdcfff1647ac4569b96ad948bf991c60 May 11 07:44:36.891221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-TestMinimumBasicScenario-928645904-project May 11 07:44:36.891221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:44:36.891221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 could not be found. May 11 07:44:36.891221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '5b5d5c60-3790-4889-92a4-0bd325a22b43'} May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 could not be found. May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:44:36.892120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 could not be found. May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 could not be found. May 11 07:44:36.893642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:36.894998 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c83b7b12-12c6-46ca-a8f6-58059a9ae14e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Returning 404 to user: Instance 5b5d5c60-3790-4889-92a4-0bd325a22b43 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:44:36.894998 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c83b7b12-12c6-46ca-a8f6-58059a9ae14e tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43" status: 404 len: 111 microversion: 2.1 time: 0.029061 May 11 07:44:36.894998 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 336/675] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:44:36 2022] GET /compute/v2.1/servers/5b5d5c60-3790-4889-92a4-0bd325a22b43 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 07:44:36.895236 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-533772d1-6057-45da-b9fd-cbf4642acf45 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042279 May 11 07:44:36.895236 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 340/676] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:44:36 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 07:44:36.899532 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f54852eb-15bb-4254-9c6d-f1e476312f44 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] Calling method '.version_select at 0x7f19ed2d7790>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:36.917143 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f54852eb-15bb-4254-9c6d-f1e476312f44 tempest-TestMinimumBasicScenario-928645904 tempest-TestMinimumBasicScenario-928645904-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1547629459" status: 202 len: 0 microversion: 2.1 time: 0.021194 May 11 07:44:36.917735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 337/677] 10.222.0.36 () {58 vars in 1271 bytes} [Wed May 11 07:44:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1547629459 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 07:44:37.001375 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-97dd3187-17e5-43f4-ab1b-337fbf73d731 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:37.002338 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-97dd3187-17e5-43f4-ab1b-337fbf73d731 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:37.008168 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-97dd3187-17e5-43f4-ab1b-337fbf73d731 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:37.008620 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-97dd3187-17e5-43f4-ab1b-337fbf73d731 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:37.009374 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-97dd3187-17e5-43f4-ab1b-337fbf73d731 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:37.009844 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-97dd3187-17e5-43f4-ab1b-337fbf73d731 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:37.038439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-97dd3187-17e5-43f4-ab1b-337fbf73d731 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040975 May 11 07:44:37.038990 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 341/678] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:44:36 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 07:44:37.095631 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-92bb4a59-b87c-482a-a1c8-ccf827fd2949 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:37.096133 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-92bb4a59-b87c-482a-a1c8-ccf827fd2949 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:37.102784 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-92bb4a59-b87c-482a-a1c8-ccf827fd2949 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:37.103235 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-92bb4a59-b87c-482a-a1c8-ccf827fd2949 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:37.104092 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-92bb4a59-b87c-482a-a1c8-ccf827fd2949 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:37.104430 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-92bb4a59-b87c-482a-a1c8-ccf827fd2949 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:37.131495 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-92bb4a59-b87c-482a-a1c8-ccf827fd2949 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Going to try to terminate instance {{(pid=123600) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:44:37.210882 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-92bb4a59-b87c-482a-a1c8-ccf827fd2949 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "DELETE /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 204 len: 0 microversion: 2.1 time: 0.119300 May 11 07:44:37.211566 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 338/679] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:44:37 2022] DELETE /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:44:37.219936 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3d054408-52a1-4e6d-a136-cbac182a2ec4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:37.220542 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-3d054408-52a1-4e6d-a136-cbac182a2ec4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:37.227006 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3d054408-52a1-4e6d-a136-cbac182a2ec4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:37.227461 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3d054408-52a1-4e6d-a136-cbac182a2ec4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:37.228393 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3d054408-52a1-4e6d-a136-cbac182a2ec4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:37.228895 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3d054408-52a1-4e6d-a136-cbac182a2ec4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:37.360367 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-3d054408-52a1-4e6d-a136-cbac182a2ec4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:37.368430 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-3d054408-52a1-4e6d-a136-cbac182a2ec4 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 200 len: 1673 microversion: 2.1 time: 0.152141 May 11 07:44:37.368780 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 342/680] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:44:37 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:44:38.386508 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-0039482f-ecaf-4d2b-b0cf-5d2cb3310e51 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:38.387493 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-0039482f-ecaf-4d2b-b0cf-5d2cb3310e51 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:38.394350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0039482f-ecaf-4d2b-b0cf-5d2cb3310e51 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:38.394803 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0039482f-ecaf-4d2b-b0cf-5d2cb3310e51 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:38.395579 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0039482f-ecaf-4d2b-b0cf-5d2cb3310e51 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:38.396017 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0039482f-ecaf-4d2b-b0cf-5d2cb3310e51 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:38.614200 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0039482f-ecaf-4d2b-b0cf-5d2cb3310e51 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:38.621614 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-0039482f-ecaf-4d2b-b0cf-5d2cb3310e51 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 200 len: 1673 microversion: 2.1 time: 0.239308 May 11 07:44:38.622176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 339/681] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:44:38 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 1673 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:44:39.640019 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-85316088-6bdf-4f4d-b574-9aabd2fcaab5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:39.640831 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-85316088-6bdf-4f4d-b574-9aabd2fcaab5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:39.647737 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-85316088-6bdf-4f4d-b574-9aabd2fcaab5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:39.648181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-85316088-6bdf-4f4d-b574-9aabd2fcaab5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:39.649038 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-85316088-6bdf-4f4d-b574-9aabd2fcaab5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:39.649472 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-85316088-6bdf-4f4d-b574-9aabd2fcaab5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:39.980250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-85316088-6bdf-4f4d-b574-9aabd2fcaab5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:39.988262 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-85316088-6bdf-4f4d-b574-9aabd2fcaab5 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 200 len: 1673 microversion: 2.1 time: 0.352772 May 11 07:44:39.988843 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 343/682] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:44:39 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 1673 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:44:40.669133 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-285c502b-1652-4ba0-a7da-e79842595ed8 req-112f6c0d-3dc8-43fc-8d67-200bc1eb2201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d19445-31da-4e52-849f-b17774fef588", "name": "network-vif-deleted", "tag": "db802acb-b2fb-41d5-ae0d-61aea6391681"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:44:40.679021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-285c502b-1652-4ba0-a7da-e79842595ed8 req-112f6c0d-3dc8-43fc-8d67-200bc1eb2201 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:40.679816 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-285c502b-1652-4ba0-a7da-e79842595ed8 req-112f6c0d-3dc8-43fc-8d67-200bc1eb2201 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:40.692755 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-285c502b-1652-4ba0-a7da-e79842595ed8 req-112f6c0d-3dc8-43fc-8d67-200bc1eb2201 service nova] Creating event network-vif-deleted:db802acb-b2fb-41d5-ae0d-61aea6391681 for instance 38d19445-31da-4e52-849f-b17774fef588 on hv-cinder-83699 May 11 07:44:40.698621 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-285c502b-1652-4ba0-a7da-e79842595ed8 req-112f6c0d-3dc8-43fc-8d67-200bc1eb2201 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032853 May 11 07:44:40.699637 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 340/683] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:41.007683 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d24dd7f3-7e43-47bb-b79e-3814d3f0e721 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:41.008370 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d24dd7f3-7e43-47bb-b79e-3814d3f0e721 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:41.014952 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d24dd7f3-7e43-47bb-b79e-3814d3f0e721 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:41.015401 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d24dd7f3-7e43-47bb-b79e-3814d3f0e721 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:41.016175 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d24dd7f3-7e43-47bb-b79e-3814d3f0e721 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:41.016610 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d24dd7f3-7e43-47bb-b79e-3814d3f0e721 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:41.101115 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d24dd7f3-7e43-47bb-b79e-3814d3f0e721 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:41.101700 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d24dd7f3-7e43-47bb-b79e-3814d3f0e721 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:41.102265 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.objects.instance [None req-d24dd7f3-7e43-47bb-b79e-3814d3f0e721 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lazy-loading 'fault' on Instance uuid 38d19445-31da-4e52-849f-b17774fef588 {{(pid=123599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:44:41.166648 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d24dd7f3-7e43-47bb-b79e-3814d3f0e721 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7271d8e9424bb7ad8ce1143fc71de9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9750cb9309234cb1b63343050ba700f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:41.179789 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d24dd7f3-7e43-47bb-b79e-3814d3f0e721 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 200 len: 1328 microversion: 2.1 time: 0.176514 May 11 07:44:41.181857 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 344/684] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:44:41 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 1328 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:44:42.199004 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-de0c6d87-3f3e-4164-b472-77472738ff47 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:42.200060 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-de0c6d87-3f3e-4164-b472-77472738ff47 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:42.207211 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-de0c6d87-3f3e-4164-b472-77472738ff47 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:42.207831 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-de0c6d87-3f3e-4164-b472-77472738ff47 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:42.208767 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-de0c6d87-3f3e-4164-b472-77472738ff47 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:42.209217 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-de0c6d87-3f3e-4164-b472-77472738ff47 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:42.223715 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-de0c6d87-3f3e-4164-b472-77472738ff47 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] HTTP exception thrown: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-de0c6d87-3f3e-4164-b472-77472738ff47 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Request method failure captured: May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 HTTP/1.1 May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2gwcFxlgwT1958No_L1WwQW6zk6fYuQHg_KPUnhySA_8sTYgG9h0IA9XiK5qqPMKtkDNBSXF2-Gd-ZGB_px5NID_-EPdzy81vOG6gmFYh7EMatUVJzYS9LjCwt7sZCBwLlk7DpqCxZLX3hvPBe_DGLrYdmyyUIBEL6Dh4P6N41oyyg May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 9750cb9309234cb1b63343050ba700f9 May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:44:42.225349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:44:42.226977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9750cb9309234cb1b63343050ba700f9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9750cb9309234cb1b63343050ba700f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9750cb9309234cb1b63343050ba700f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9750cb9309234cb1b63343050ba700f9"}]}] May 11 07:44:42.226977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:42.226977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 9750cb9309234cb1b63343050ba700f9 May 11 07:44:42.226977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:42.226977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-AttachVolumeTestJSON-1030254869-project May 11 07:44:42.226977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:44:42.226977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:44:42.226977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: ad7271d8e9424bb7ad8ce1143fc71de9 May 11 07:44:42.226977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-AttachVolumeTestJSON-1030254869-project May 11 07:44:42.226977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:44:42.226977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:42.226977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '38d19445-31da-4e52-849f-b17774fef588'} May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:44:42.227963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:42.229376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:42.230541 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-de0c6d87-3f3e-4164-b472-77472738ff47 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Returning 404 to user: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:44:42.230541 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-de0c6d87-3f3e-4164-b472-77472738ff47 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 404 len: 111 microversion: 2.1 time: 0.032691 May 11 07:44:42.230541 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 341/685] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:44:42 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:44:42.236764 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0889ba57-f736-4d18-8f16-8dfc33934c47 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '.version_select at 0x7f19ec8360d0>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:42.254158 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0889ba57-f736-4d18-8f16-8dfc33934c47 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082201760" status: 202 len: 0 microversion: 2.1 time: 0.021642 May 11 07:44:42.254724 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 345/686] 10.222.0.36 () {58 vars in 1220 bytes} [Wed May 11 07:44:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082201760 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:44:45.416165 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8f4666dc-67e7-4d3b-be6c-54cd25afd311 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:45.416651 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8f4666dc-67e7-4d3b-be6c-54cd25afd311 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:45.423763 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f4666dc-67e7-4d3b-be6c-54cd25afd311 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:45.424488 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f4666dc-67e7-4d3b-be6c-54cd25afd311 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:45.425462 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f4666dc-67e7-4d3b-be6c-54cd25afd311 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:45.425935 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f4666dc-67e7-4d3b-be6c-54cd25afd311 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:45.441840 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-8f4666dc-67e7-4d3b-be6c-54cd25afd311 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] HTTP exception thrown: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8f4666dc-67e7-4d3b-be6c-54cd25afd311 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Request method failure captured: May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: DELETE /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 HTTP/1.1 May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2gwcFxlgwT1958No_L1WwQW6zk6fYuQHg_KPUnhySA_8sTYgG9h0IA9XiK5qqPMKtkDNBSXF2-Gd-ZGB_px5NID_-EPdzy81vOG6gmFYh7EMatUVJzYS9LjCwt7sZCBwLlk7DpqCxZLX3hvPBe_DGLrYdmyyUIBEL6Dh4P6N41oyyg May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 9750cb9309234cb1b63343050ba700f9 May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:44:45.443562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:44:45.445220 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9750cb9309234cb1b63343050ba700f9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9750cb9309234cb1b63343050ba700f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9750cb9309234cb1b63343050ba700f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9750cb9309234cb1b63343050ba700f9"}]}] May 11 07:44:45.445220 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:45.445220 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 9750cb9309234cb1b63343050ba700f9 May 11 07:44:45.445220 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:45.445220 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-AttachVolumeTestJSON-1030254869-project May 11 07:44:45.445220 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:44:45.445220 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:44:45.445220 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: ad7271d8e9424bb7ad8ce1143fc71de9 May 11 07:44:45.445220 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-AttachVolumeTestJSON-1030254869-project May 11 07:44:45.445220 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:44:45.445220 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:45.445220 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '38d19445-31da-4e52-849f-b17774fef588'} May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:44:45.446081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:45.447445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:45.448884 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8f4666dc-67e7-4d3b-be6c-54cd25afd311 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Returning 404 to user: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:44:45.448884 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8f4666dc-67e7-4d3b-be6c-54cd25afd311 tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "DELETE /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 404 len: 111 microversion: 2.1 time: 0.032849 May 11 07:44:45.448884 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 342/687] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:44:45 2022] DELETE /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:44:45.454919 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-caed0a18-a58e-430e-964c-e686469ee4cf tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:45.455530 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-caed0a18-a58e-430e-964c-e686469ee4cf tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 38d19445-31da-4e52-849f-b17774fef588] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:45.463530 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-caed0a18-a58e-430e-964c-e686469ee4cf tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:45.463988 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-caed0a18-a58e-430e-964c-e686469ee4cf tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:45.464788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-caed0a18-a58e-430e-964c-e686469ee4cf tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:45.465210 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-caed0a18-a58e-430e-964c-e686469ee4cf tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:45.480082 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-caed0a18-a58e-430e-964c-e686469ee4cf tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] HTTP exception thrown: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-caed0a18-a58e-430e-964c-e686469ee4cf tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Request method failure captured: May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 HTTP/1.1 May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2gwcFxlgwT1958No_L1WwQW6zk6fYuQHg_KPUnhySA_8sTYgG9h0IA9XiK5qqPMKtkDNBSXF2-Gd-ZGB_px5NID_-EPdzy81vOG6gmFYh7EMatUVJzYS9LjCwt7sZCBwLlk7DpqCxZLX3hvPBe_DGLrYdmyyUIBEL6Dh4P6N41oyyg May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 9750cb9309234cb1b63343050ba700f9 May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:44:45.482202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:44:45.483722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9750cb9309234cb1b63343050ba700f9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9750cb9309234cb1b63343050ba700f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9750cb9309234cb1b63343050ba700f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9750cb9309234cb1b63343050ba700f9"}]}] May 11 07:44:45.483722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:45.483722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 9750cb9309234cb1b63343050ba700f9 May 11 07:44:45.483722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:45.483722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-AttachVolumeTestJSON-1030254869-project May 11 07:44:45.483722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:44:45.483722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:44:45.483722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: ad7271d8e9424bb7ad8ce1143fc71de9 May 11 07:44:45.483722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-AttachVolumeTestJSON-1030254869-project May 11 07:44:45.483722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:44:45.483722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:45.483722 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '38d19445-31da-4e52-849f-b17774fef588'} May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:44:45.484581 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. May 11 07:44:45.486086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:45.489111 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-caed0a18-a58e-430e-964c-e686469ee4cf tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Returning 404 to user: Instance 38d19445-31da-4e52-849f-b17774fef588 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:44:45.490019 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-caed0a18-a58e-430e-964c-e686469ee4cf tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588" status: 404 len: 111 microversion: 2.1 time: 0.040304 May 11 07:44:45.490592 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 346/688] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:44:45 2022] GET /compute/v2.1/servers/38d19445-31da-4e52-849f-b17774fef588 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:44:46.638083 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5f902072-145d-4945-ae0c-bfff117d42bd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:46.638608 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-5f902072-145d-4945-ae0c-bfff117d42bd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:46.644907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5f902072-145d-4945-ae0c-bfff117d42bd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:46.645380 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5f902072-145d-4945-ae0c-bfff117d42bd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:46.646191 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5f902072-145d-4945-ae0c-bfff117d42bd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:46.646631 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5f902072-145d-4945-ae0c-bfff117d42bd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:46.659601 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-5f902072-145d-4945-ae0c-bfff117d42bd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] HTTP exception thrown: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5f902072-145d-4945-ae0c-bfff117d42bd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Request method failure captured: May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: DELETE /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 HTTP/1.1 May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2gwcFxlgwT1958No_L1WwQW6zk6fYuQHg_KPUnhySA_8sTYgG9h0IA9XiK5qqPMKtkDNBSXF2-Gd-ZGB_px5NID_-EPdzy81vOG6gmFYh7EMatUVJzYS9LjCwt7sZCBwLlk7DpqCxZLX3hvPBe_DGLrYdmyyUIBEL6Dh4P6N41oyyg May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 9750cb9309234cb1b63343050ba700f9 May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:44:46.661111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:44:46.662639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9750cb9309234cb1b63343050ba700f9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9750cb9309234cb1b63343050ba700f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9750cb9309234cb1b63343050ba700f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9750cb9309234cb1b63343050ba700f9"}]}] May 11 07:44:46.662639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:46.662639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 9750cb9309234cb1b63343050ba700f9 May 11 07:44:46.662639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:46.662639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-AttachVolumeTestJSON-1030254869-project May 11 07:44:46.662639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:44:46.662639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:44:46.662639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: ad7271d8e9424bb7ad8ce1143fc71de9 May 11 07:44:46.662639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-AttachVolumeTestJSON-1030254869-project May 11 07:44:46.662639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:44:46.662639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:44:46.662639 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '9e62bda3-ed20-4c7e-a3c8-aa90f6f79937'} May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:44:46.663458 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:44:46.664826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:46.666239 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5f902072-145d-4945-ae0c-bfff117d42bd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Returning 404 to user: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:44:46.666239 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-5f902072-145d-4945-ae0c-bfff117d42bd tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 404 len: 111 microversion: 2.1 time: 0.028295 May 11 07:44:46.666239 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 343/689] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:44:46 2022] DELETE /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:44:46.671106 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-da7e86fa-6093-4b3b-8ce1-879fa8469fed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:46.671715 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-da7e86fa-6093-4b3b-8ce1-879fa8469fed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] [instance: 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:46.678019 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-da7e86fa-6093-4b3b-8ce1-879fa8469fed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:46.678459 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-da7e86fa-6093-4b3b-8ce1-879fa8469fed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:46.679215 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-da7e86fa-6093-4b3b-8ce1-879fa8469fed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:46.679646 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-da7e86fa-6093-4b3b-8ce1-879fa8469fed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:46.693728 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-da7e86fa-6093-4b3b-8ce1-879fa8469fed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] HTTP exception thrown: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-da7e86fa-6093-4b3b-8ce1-879fa8469fed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Request method failure captured: May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 HTTP/1.1 May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2gwcFxlgwT1958No_L1WwQW6zk6fYuQHg_KPUnhySA_8sTYgG9h0IA9XiK5qqPMKtkDNBSXF2-Gd-ZGB_px5NID_-EPdzy81vOG6gmFYh7EMatUVJzYS9LjCwt7sZCBwLlk7DpqCxZLX3hvPBe_DGLrYdmyyUIBEL6Dh4P6N41oyyg May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 9750cb9309234cb1b63343050ba700f9 May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:44:46.695227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:44:46.696840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9750cb9309234cb1b63343050ba700f9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9750cb9309234cb1b63343050ba700f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9750cb9309234cb1b63343050ba700f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9750cb9309234cb1b63343050ba700f9"}]}] May 11 07:44:46.696840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:46.696840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 9750cb9309234cb1b63343050ba700f9 May 11 07:44:46.696840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1030254869 May 11 07:44:46.696840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-AttachVolumeTestJSON-1030254869-project May 11 07:44:46.696840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:44:46.696840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:44:46.696840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: ad7271d8e9424bb7ad8ce1143fc71de9 May 11 07:44:46.696840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-AttachVolumeTestJSON-1030254869-project May 11 07:44:46.696840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:44:46.696840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:44:46.696840 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '9e62bda3-ed20-4c7e-a3c8-aa90f6f79937'} May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:44:46.698591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. May 11 07:44:46.700004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:46.701226 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-da7e86fa-6093-4b3b-8ce1-879fa8469fed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] Returning 404 to user: Instance 9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:44:46.701226 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-da7e86fa-6093-4b3b-8ce1-879fa8469fed tempest-AttachVolumeTestJSON-1030254869 tempest-AttachVolumeTestJSON-1030254869-project] 10.222.0.36 "GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937" status: 404 len: 111 microversion: 2.1 time: 0.029717 May 11 07:44:46.701226 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 347/690] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:44:46 2022] GET /compute/v2.1/servers/9e62bda3-ed20-4c7e-a3c8-aa90f6f79937 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 07:44:51.076749 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-62cf2aa0-718f-4e2c-88d2-cac9de2243a0 tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] Action: 'create', calling method: .version_select at 0x7f19ec7ab3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-167721289", "metadata": {"Type": "work"}}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:44:51.346188 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-62cf2aa0-718f-4e2c-88d2-cac9de2243a0 tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.381705 May 11 07:44:51.349847 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 344/691] 10.222.0.36 () {60 vars in 1155 bytes} [Wed May 11 07:44:50 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 386 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 11 07:44:51.360808 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-4a10b355-c710-4624-9df2-f7e47b163013 tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] Calling method '.version_select at 0x7f19ec8fa820>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:51.413486 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-4a10b355-c710-4624-9df2-f7e47b163013 tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/3b614968-e2e3-4662-9bb0-9954aa05b268" status: 200 len: 352 microversion: 2.1 time: 0.056618 May 11 07:44:51.414340 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 348/692] 10.222.0.36 () {58 vars in 1244 bytes} [Wed May 11 07:44:51 2022] GET /compute/v2.1/os-volumes/3b614968-e2e3-4662-9bb0-9954aa05b268 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:52.426969 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-0396a3ca-7018-45c9-af60-9777539ab36b tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] Calling method '.version_select at 0x7f19ec702280>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:52.474870 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-0396a3ca-7018-45c9-af60-9777539ab36b tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/3b614968-e2e3-4662-9bb0-9954aa05b268" status: 200 len: 353 microversion: 2.1 time: 0.052040 May 11 07:44:52.475444 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 345/693] 10.222.0.36 () {58 vars in 1244 bytes} [Wed May 11 07:44:52 2022] GET /compute/v2.1/os-volumes/3b614968-e2e3-4662-9bb0-9954aa05b268 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:52.487527 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b96b8f47-f815-4393-93d3-fdd3befdc52e tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] Calling method '.version_select at 0x7f19ec8de280>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:52.540199 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-82df83c0-1e82-4ef1-8955-0428d3344dff tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:52.541163 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-82df83c0-1e82-4ef1-8955-0428d3344dff tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:52.544043 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-b96b8f47-f815-4393-93d3-fdd3befdc52e tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/3b614968-e2e3-4662-9bb0-9954aa05b268" status: 200 len: 353 microversion: 2.1 time: 0.060829 May 11 07:44:52.544749 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 349/694] 10.222.0.36 () {58 vars in 1244 bytes} [Wed May 11 07:44:52 2022] GET /compute/v2.1/os-volumes/3b614968-e2e3-4662-9bb0-9954aa05b268 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:52.549562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-82df83c0-1e82-4ef1-8955-0428d3344dff tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:52.550128 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-82df83c0-1e82-4ef1-8955-0428d3344dff tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:52.551024 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-82df83c0-1e82-4ef1-8955-0428d3344dff tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:52.551559 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-82df83c0-1e82-4ef1-8955-0428d3344dff tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:52.560846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3a4f639e-e37a-480a-a635-b211689fef92 tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] Calling method '.version_select at 0x7f19ec836820>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:52.580341 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-82df83c0-1e82-4ef1-8955-0428d3344dff tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043969 May 11 07:44:52.580890 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 346/695] 10.222.0.36 () {60 vars in 1342 bytes} [Wed May 11 07:44:52 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:44:52.619774 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-3a4f639e-e37a-480a-a635-b211689fef92 tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/3b614968-e2e3-4662-9bb0-9954aa05b268" status: 202 len: 0 microversion: 2.1 time: 0.062560 May 11 07:44:52.620337 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 350/696] 10.222.0.36 () {58 vars in 1247 bytes} [Wed May 11 07:44:52 2022] DELETE /compute/v2.1/os-volumes/3b614968-e2e3-4662-9bb0-9954aa05b268 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 07:44:52.628226 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c52eab5d-ee34-4797-8297-fcd8c100d397 tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] Calling method '.version_select at 0x7f19ed247d30>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:52.640721 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-932f210d-92ef-4b10-9d3c-ec668d748cd6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:52.641274 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-932f210d-92ef-4b10-9d3c-ec668d748cd6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:52.648616 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-932f210d-92ef-4b10-9d3c-ec668d748cd6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:52.649192 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-932f210d-92ef-4b10-9d3c-ec668d748cd6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:52.650019 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-932f210d-92ef-4b10-9d3c-ec668d748cd6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:52.650549 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-932f210d-92ef-4b10-9d3c-ec668d748cd6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:52.673116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c52eab5d-ee34-4797-8297-fcd8c100d397 tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/3b614968-e2e3-4662-9bb0-9954aa05b268" status: 200 len: 352 microversion: 2.1 time: 0.048574 May 11 07:44:52.673879 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 347/697] 10.222.0.36 () {58 vars in 1244 bytes} [Wed May 11 07:44:52 2022] GET /compute/v2.1/os-volumes/3b614968-e2e3-4662-9bb0-9954aa05b268 => generated 352 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:52.675795 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-932f210d-92ef-4b10-9d3c-ec668d748cd6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Going to try to terminate instance {{(pid=123599) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:44:52.748171 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-932f210d-92ef-4b10-9d3c-ec668d748cd6 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 204 len: 0 microversion: 2.20 time: 0.111692 May 11 07:44:52.748996 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 351/698] 10.222.0.36 () {60 vars in 1279 bytes} [Wed May 11 07:44:52 2022] DELETE /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 11 07:44:52.757438 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f334980f-7182-4688-a463-a1d7d37eade0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:52.758108 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f334980f-7182-4688-a463-a1d7d37eade0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:52.764396 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f334980f-7182-4688-a463-a1d7d37eade0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:52.764844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f334980f-7182-4688-a463-a1d7d37eade0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:52.765620 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f334980f-7182-4688-a463-a1d7d37eade0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:52.766052 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f334980f-7182-4688-a463-a1d7d37eade0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:52.897752 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f334980f-7182-4688-a463-a1d7d37eade0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:52.905994 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f334980f-7182-4688-a463-a1d7d37eade0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:52.907475 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f334980f-7182-4688-a463-a1d7d37eade0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:52.908618 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f334980f-7182-4688-a463-a1d7d37eade0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.155131 May 11 07:44:52.909170 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 348/699] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:52 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:53.685704 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-46649152-dce5-4e4b-98a0-31c426a55ef7 tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] Calling method '.version_select at 0x7f19ec8e2dc0>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:53.712758 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-46649152-dce5-4e4b-98a0-31c426a55ef7 tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] HTTP exception thrown: Volume 3b614968-e2e3-4662-9bb0-9954aa05b268 could not be found. May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-46649152-dce5-4e4b-98a0-31c426a55ef7 tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] Request method failure captured: May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/os-volumes/3b614968-e2e3-4662-9bb0-9954aa05b268 HTTP/1.1 May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2lyBxukiKSAuWcnCmhCG-RBINvyDKfluzHxVVQ-JtpWCpp5F64b0Xr1OVQjY0nU5cHVQHqHkII9kIzB5UY0SswQUmpPD55-7LPesD4-qwxUTQQlbjRrv4A3-JRxCpzHqZdO166IVgF-DNjghdc2czlObMvf8de41JLNQA0QA0DewIo May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: c3f28b4427b84f3db1aa6838d608faf2 May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-VolumesGetTestJSON-695247947 May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:44:53.714869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:44:53.716427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c3f28b4427b84f3db1aa6838d608faf2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c3f28b4427b84f3db1aa6838d608faf2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c3f28b4427b84f3db1aa6838d608faf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c3f28b4427b84f3db1aa6838d608faf2"}]}] May 11 07:44:53.716427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-VolumesGetTestJSON-695247947 May 11 07:44:53.716427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: c3f28b4427b84f3db1aa6838d608faf2 May 11 07:44:53.716427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-VolumesGetTestJSON-695247947 May 11 07:44:53.716427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-VolumesGetTestJSON-695247947-project May 11 07:44:53.716427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:44:53.716427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:44:53.716427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: d293965e7f004c44b27e272dc1ab0342 May 11 07:44:53.716427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-VolumesGetTestJSON-695247947-project May 11 07:44:53.716427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: May 11 07:44:53.716427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Volume 3b614968-e2e3-4662-9bb0-9954aa05b268 could not be found. May 11 07:44:53.716427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '3b614968-e2e3-4662-9bb0-9954aa05b268'} May 11 07:44:53.716427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b614968-e2e3-4662-9bb0-9954aa05b268 could not be found. (HTTP 404) (Request-ID: req-9a797759-257a-4da1-93fd-16a04e50aa75) May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:53.717320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 07:44:53.718797 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b614968-e2e3-4662-9bb0-9954aa05b268 could not be found. May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 07:44:53.720133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:44:53.721465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b614968-e2e3-4662-9bb0-9954aa05b268 could not be found. May 11 07:44:53.721465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:53.721465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:53.721465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:53.721465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:53.721465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:53.721465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:53.721465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:44:53.721465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:44:53.721465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b614968-e2e3-4662-9bb0-9954aa05b268 could not be found. May 11 07:44:53.721465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:53.721465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-46649152-dce5-4e4b-98a0-31c426a55ef7 tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] Returning 404 to user: Volume 3b614968-e2e3-4662-9bb0-9954aa05b268 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:44:53.721465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-46649152-dce5-4e4b-98a0-31c426a55ef7 tempest-VolumesGetTestJSON-695247947 tempest-VolumesGetTestJSON-695247947-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/3b614968-e2e3-4662-9bb0-9954aa05b268" status: 404 len: 109 microversion: 2.1 time: 0.035296 May 11 07:44:53.721465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 352/700] 10.222.0.36 () {58 vars in 1244 bytes} [Wed May 11 07:44:53 2022] GET /compute/v2.1/os-volumes/3b614968-e2e3-4662-9bb0-9954aa05b268 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:44:53.927840 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9f4bae26-887c-4f25-9eb7-37e2adef34fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:53.928460 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9f4bae26-887c-4f25-9eb7-37e2adef34fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:53.935305 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9f4bae26-887c-4f25-9eb7-37e2adef34fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:53.935862 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9f4bae26-887c-4f25-9eb7-37e2adef34fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:53.936858 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9f4bae26-887c-4f25-9eb7-37e2adef34fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:53.937316 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9f4bae26-887c-4f25-9eb7-37e2adef34fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:54.086194 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9f4bae26-887c-4f25-9eb7-37e2adef34fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:54.093971 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9f4bae26-887c-4f25-9eb7-37e2adef34fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:54.095481 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9f4bae26-887c-4f25-9eb7-37e2adef34fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:54.096629 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9f4bae26-887c-4f25-9eb7-37e2adef34fa tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1724 microversion: 2.20 time: 0.172916 May 11 07:44:54.097181 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 349/701] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:53 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:55.118303 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d29dedc9-839f-4057-a38d-46ae62916589 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:55.119018 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d29dedc9-839f-4057-a38d-46ae62916589 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:55.125618 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d29dedc9-839f-4057-a38d-46ae62916589 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:55.126073 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d29dedc9-839f-4057-a38d-46ae62916589 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:55.126861 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d29dedc9-839f-4057-a38d-46ae62916589 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:55.127297 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d29dedc9-839f-4057-a38d-46ae62916589 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:55.352104 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d29dedc9-839f-4057-a38d-46ae62916589 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:55.394352 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d29dedc9-839f-4057-a38d-46ae62916589 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:55.395850 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d29dedc9-839f-4057-a38d-46ae62916589 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c6bb9dabb1fc46dda1fe1906ab248c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '075ba180d52b46ad9cd3334520bcfb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:44:55.406107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d29dedc9-839f-4057-a38d-46ae62916589 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 200 len: 1657 microversion: 2.20 time: 0.293386 May 11 07:44:55.406686 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 353/702] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:55 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 1657 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 07:44:55.422331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-e7c1fa9e-be1e-497d-ba92-b40586f20cdf req-1562c577-af26-491a-99a4-37a35205f477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03c4e26-68ab-49e2-ac51-aa3bce79d3e7", "name": "network-vif-deleted", "tag": "c341b877-b342-4956-94f6-3c4bcad3497f"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:44:55.432233 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-e7c1fa9e-be1e-497d-ba92-b40586f20cdf req-1562c577-af26-491a-99a4-37a35205f477 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:55.432858 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-e7c1fa9e-be1e-497d-ba92-b40586f20cdf req-1562c577-af26-491a-99a4-37a35205f477 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:55.453877 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-e7c1fa9e-be1e-497d-ba92-b40586f20cdf req-1562c577-af26-491a-99a4-37a35205f477 service nova] Creating event network-vif-deleted:c341b877-b342-4956-94f6-3c4bcad3497f for instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 on hv-cinder-83699 May 11 07:44:55.461354 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-e7c1fa9e-be1e-497d-ba92-b40586f20cdf req-1562c577-af26-491a-99a4-37a35205f477 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043587 May 11 07:44:55.463433 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 350/703] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:44:56.425059 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2c103341-610a-4a21-aadb-ff18bf171c5f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:56.425792 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2c103341-610a-4a21-aadb-ff18bf171c5f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:56.432140 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c103341-610a-4a21-aadb-ff18bf171c5f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:56.432873 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c103341-610a-4a21-aadb-ff18bf171c5f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:56.433906 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c103341-610a-4a21-aadb-ff18bf171c5f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:56.434416 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c103341-610a-4a21-aadb-ff18bf171c5f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:56.448529 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-2c103341-610a-4a21-aadb-ff18bf171c5f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] HTTP exception thrown: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2c103341-610a-4a21-aadb-ff18bf171c5f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Request method failure captured: May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 HTTP/1.1 May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2f3v84IZYnek7zcw0tLHLZpD6JOAeQvBcoLWjFTheTiJdvY4jW4_aJpACbxVCHUXSDJMwX4jtKCGxALwsMnKLf5vGzaLkPI9x0RYTuB_2NOtuaN8bm7d5uwHt6isBDRnYPw-m9mYCi6NbFUVrRMjKTqmHlhoMp-_VPl36SPSCBOHrw May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Openstack-Nova-Api-Version: 2.20 May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 075ba180d52b46ad9cd3334520bcfb89 May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:44:56.450116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:44:56.451509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_075ba180d52b46ad9cd3334520bcfb89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/075ba180d52b46ad9cd3334520bcfb89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/075ba180d52b46ad9cd3334520bcfb89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/075ba180d52b46ad9cd3334520bcfb89"}]}] May 11 07:44:56.451509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:44:56.451509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 075ba180d52b46ad9cd3334520bcfb89 May 11 07:44:56.451509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:44:56.451509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-AttachVolumeShelveTestJSON-1490332633-project May 11 07:44:56.451509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:44:56.451509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:44:56.451509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: c6bb9dabb1fc46dda1fe1906ab248c57 May 11 07:44:56.451509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490332633-project May 11 07:44:56.451509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:44:56.451509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:56.451509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': 'd03c4e26-68ab-49e2-ac51-aa3bce79d3e7'} May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:44:56.452267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:56.453458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:56.454599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2c103341-610a-4a21-aadb-ff18bf171c5f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Returning 404 to user: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:44:56.454599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2c103341-610a-4a21-aadb-ff18bf171c5f tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 404 len: 111 microversion: 2.20 time: 0.030465 May 11 07:44:56.454599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 354/704] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:56 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 07:44:56.466259 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-80df1cdb-d928-48e2-ac01-f49fae12dd9d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '.version_select at 0x7f19ed1ee160>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:56.486670 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-80df1cdb-d928-48e2-ac01-f49fae12dd9d tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-509589221" status: 204 len: 0 microversion: 2.20 time: 0.026324 May 11 07:44:56.487454 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 351/705] 10.222.0.36 () {60 vars in 1258 bytes} [Wed May 11 07:44:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-509589221 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 07:44:58.204861 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-dce7a348-f9f6-4a1b-899d-a693ae5d1291 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:58.205374 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-dce7a348-f9f6-4a1b-899d-a693ae5d1291 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:58.211690 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dce7a348-f9f6-4a1b-899d-a693ae5d1291 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:58.212133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dce7a348-f9f6-4a1b-899d-a693ae5d1291 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:58.213099 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dce7a348-f9f6-4a1b-899d-a693ae5d1291 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:58.213531 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dce7a348-f9f6-4a1b-899d-a693ae5d1291 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:58.228131 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-dce7a348-f9f6-4a1b-899d-a693ae5d1291 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] HTTP exception thrown: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-dce7a348-f9f6-4a1b-899d-a693ae5d1291 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Request method failure captured: May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: DELETE /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 HTTP/1.1 May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2f3v84IZYnek7zcw0tLHLZpD6JOAeQvBcoLWjFTheTiJdvY4jW4_aJpACbxVCHUXSDJMwX4jtKCGxALwsMnKLf5vGzaLkPI9x0RYTuB_2NOtuaN8bm7d5uwHt6isBDRnYPw-m9mYCi6NbFUVrRMjKTqmHlhoMp-_VPl36SPSCBOHrw May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Openstack-Nova-Api-Version: 2.20 May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 075ba180d52b46ad9cd3334520bcfb89 May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:44:58.229696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:44:58.231223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_075ba180d52b46ad9cd3334520bcfb89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/075ba180d52b46ad9cd3334520bcfb89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/075ba180d52b46ad9cd3334520bcfb89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/075ba180d52b46ad9cd3334520bcfb89"}]}] May 11 07:44:58.231223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:44:58.231223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 075ba180d52b46ad9cd3334520bcfb89 May 11 07:44:58.231223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:44:58.231223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-AttachVolumeShelveTestJSON-1490332633-project May 11 07:44:58.231223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:44:58.231223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:44:58.231223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: c6bb9dabb1fc46dda1fe1906ab248c57 May 11 07:44:58.231223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490332633-project May 11 07:44:58.231223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:44:58.231223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:58.231223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': 'd03c4e26-68ab-49e2-ac51-aa3bce79d3e7'} May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:44:58.232027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:58.234369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:44:58.235541 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-dce7a348-f9f6-4a1b-899d-a693ae5d1291 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Returning 404 to user: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:44:58.235541 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-dce7a348-f9f6-4a1b-899d-a693ae5d1291 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 404 len: 111 microversion: 2.20 time: 0.030223 May 11 07:44:58.235541 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 355/706] 10.222.0.36 () {60 vars in 1279 bytes} [Wed May 11 07:44:58 2022] DELETE /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 07:44:58.241213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-aea3d850-e7d0-448e-a0da-fab656cddea0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:44:58.241967 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-aea3d850-e7d0-448e-a0da-fab656cddea0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: d03c4e26-68ab-49e2-ac51-aa3bce79d3e7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:44:58.248643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aea3d850-e7d0-448e-a0da-fab656cddea0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:58.249105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aea3d850-e7d0-448e-a0da-fab656cddea0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:58.249917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aea3d850-e7d0-448e-a0da-fab656cddea0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:44:58.250364 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-aea3d850-e7d0-448e-a0da-fab656cddea0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:44:58.263268 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-aea3d850-e7d0-448e-a0da-fab656cddea0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] HTTP exception thrown: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-aea3d850-e7d0-448e-a0da-fab656cddea0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Request method failure captured: May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 HTTP/1.1 May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2f3v84IZYnek7zcw0tLHLZpD6JOAeQvBcoLWjFTheTiJdvY4jW4_aJpACbxVCHUXSDJMwX4jtKCGxALwsMnKLf5vGzaLkPI9x0RYTuB_2NOtuaN8bm7d5uwHt6isBDRnYPw-m9mYCi6NbFUVrRMjKTqmHlhoMp-_VPl36SPSCBOHrw May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Openstack-Nova-Api-Version: 2.20 May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 075ba180d52b46ad9cd3334520bcfb89 May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:44:58.264981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:44:58.266616 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_075ba180d52b46ad9cd3334520bcfb89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/075ba180d52b46ad9cd3334520bcfb89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/075ba180d52b46ad9cd3334520bcfb89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/075ba180d52b46ad9cd3334520bcfb89"}]}] May 11 07:44:58.266616 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:44:58.266616 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 075ba180d52b46ad9cd3334520bcfb89 May 11 07:44:58.266616 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:44:58.266616 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-AttachVolumeShelveTestJSON-1490332633-project May 11 07:44:58.266616 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:44:58.266616 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:44:58.266616 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: c6bb9dabb1fc46dda1fe1906ab248c57 May 11 07:44:58.266616 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490332633-project May 11 07:44:58.266616 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:44:58.266616 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:58.266616 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': 'd03c4e26-68ab-49e2-ac51-aa3bce79d3e7'} May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:44:58.267590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. May 11 07:44:58.269731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:44:58.271021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-aea3d850-e7d0-448e-a0da-fab656cddea0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Returning 404 to user: Instance d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:44:58.271021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-aea3d850-e7d0-448e-a0da-fab656cddea0 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7" status: 404 len: 111 microversion: 2.20 time: 0.029536 May 11 07:44:58.271021 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 352/707] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:44:58 2022] GET /compute/v2.1/servers/d03c4e26-68ab-49e2-ac51-aa3bce79d3e7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 07:45:00.442207 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-8185d437-be3b-41ae-8343-18d111808962 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:00.442834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-8185d437-be3b-41ae-8343-18d111808962 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:00.449312 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8185d437-be3b-41ae-8343-18d111808962 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:00.449786 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8185d437-be3b-41ae-8343-18d111808962 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:00.450547 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8185d437-be3b-41ae-8343-18d111808962 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:00.451542 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-8185d437-be3b-41ae-8343-18d111808962 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:00.465324 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-8185d437-be3b-41ae-8343-18d111808962 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] HTTP exception thrown: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-8185d437-be3b-41ae-8343-18d111808962 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Request method failure captured: May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: DELETE /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 HTTP/1.1 May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2f3v84IZYnek7zcw0tLHLZpD6JOAeQvBcoLWjFTheTiJdvY4jW4_aJpACbxVCHUXSDJMwX4jtKCGxALwsMnKLf5vGzaLkPI9x0RYTuB_2NOtuaN8bm7d5uwHt6isBDRnYPw-m9mYCi6NbFUVrRMjKTqmHlhoMp-_VPl36SPSCBOHrw May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Openstack-Nova-Api-Version: 2.20 May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 075ba180d52b46ad9cd3334520bcfb89 May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:45:00.467086 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:45:00.468687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_075ba180d52b46ad9cd3334520bcfb89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/075ba180d52b46ad9cd3334520bcfb89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/075ba180d52b46ad9cd3334520bcfb89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/075ba180d52b46ad9cd3334520bcfb89"}]}] May 11 07:45:00.468687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:45:00.468687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 075ba180d52b46ad9cd3334520bcfb89 May 11 07:45:00.468687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:45:00.468687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-AttachVolumeShelveTestJSON-1490332633-project May 11 07:45:00.468687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:45:00.468687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:45:00.468687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: c6bb9dabb1fc46dda1fe1906ab248c57 May 11 07:45:00.468687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490332633-project May 11 07:45:00.468687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:45:00.468687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:45:00.468687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': 'acfe41f4-cc5e-4cc7-bc04-ebff35bfd769'} May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:45:00.469440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:45:00.471357 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:45:00.473067 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-8185d437-be3b-41ae-8343-18d111808962 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Returning 404 to user: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:45:00.473067 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-8185d437-be3b-41ae-8343-18d111808962 tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "DELETE /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 404 len: 111 microversion: 2.20 time: 0.030413 May 11 07:45:00.473067 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 356/708] 10.222.0.36 () {60 vars in 1279 bytes} [Wed May 11 07:45:00 2022] DELETE /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 07:45:00.477729 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-6dccb026-adc2-47c6-b59c-d5e91e71076c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:00.478329 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-6dccb026-adc2-47c6-b59c-d5e91e71076c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] [instance: acfe41f4-cc5e-4cc7-bc04-ebff35bfd769] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:00.484876 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6dccb026-adc2-47c6-b59c-d5e91e71076c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:00.485724 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6dccb026-adc2-47c6-b59c-d5e91e71076c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:00.486111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6dccb026-adc2-47c6-b59c-d5e91e71076c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:00.486627 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6dccb026-adc2-47c6-b59c-d5e91e71076c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:00.500868 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-6dccb026-adc2-47c6-b59c-d5e91e71076c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] HTTP exception thrown: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-6dccb026-adc2-47c6-b59c-d5e91e71076c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Request method failure captured: May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 HTTP/1.1 May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2f3v84IZYnek7zcw0tLHLZpD6JOAeQvBcoLWjFTheTiJdvY4jW4_aJpACbxVCHUXSDJMwX4jtKCGxALwsMnKLf5vGzaLkPI9x0RYTuB_2NOtuaN8bm7d5uwHt6isBDRnYPw-m9mYCi6NbFUVrRMjKTqmHlhoMp-_VPl36SPSCBOHrw May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Openstack-Nova-Api-Version: 2.20 May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 075ba180d52b46ad9cd3334520bcfb89 May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:45:00.502413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:45:00.503988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_075ba180d52b46ad9cd3334520bcfb89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/075ba180d52b46ad9cd3334520bcfb89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/075ba180d52b46ad9cd3334520bcfb89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/075ba180d52b46ad9cd3334520bcfb89"}]}] May 11 07:45:00.503988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:45:00.503988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 075ba180d52b46ad9cd3334520bcfb89 May 11 07:45:00.503988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1490332633 May 11 07:45:00.503988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-AttachVolumeShelveTestJSON-1490332633-project May 11 07:45:00.503988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:45:00.503988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:45:00.503988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: c6bb9dabb1fc46dda1fe1906ab248c57 May 11 07:45:00.503988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1490332633-project May 11 07:45:00.503988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:45:00.503988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:45:00.503988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': 'acfe41f4-cc5e-4cc7-bc04-ebff35bfd769'} May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:45:00.504880 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. May 11 07:45:00.506310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:45:00.507605 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-6dccb026-adc2-47c6-b59c-d5e91e71076c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] Returning 404 to user: Instance acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:45:00.507605 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-6dccb026-adc2-47c6-b59c-d5e91e71076c tempest-AttachVolumeShelveTestJSON-1490332633 tempest-AttachVolumeShelveTestJSON-1490332633-project] 10.222.0.36 "GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769" status: 404 len: 111 microversion: 2.20 time: 0.030051 May 11 07:45:00.507605 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 353/709] 10.222.0.36 () {60 vars in 1276 bytes} [Wed May 11 07:45:00 2022] GET /compute/v2.1/servers/acfe41f4-cc5e-4cc7-bc04-ebff35bfd769 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 11 07:45:08.768942 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-62cc74af-a2e7-4d15-929f-c11ad4394210 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Action: 'create', calling method: .version_select at 0x7f19ec8e2310>, body: {"keypair": {"name": "tempest-keypair-783081354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4KIxVUi6kjx7VRq3yUcv2RtqnA7jTLUwKm7T7tPJhSkXGEu8s3S9RphI9MT64O2BjzMZRIcvJORJO+opJGJywySbpxc/xT6WVGXHTB1X40F7sjTI0YJiFGgSmBcV//Xw=="}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:45:08.783321 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-62cc74af-a2e7-4d15-929f-c11ad4394210 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:45:08.787189 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-62cc74af-a2e7-4d15-929f-c11ad4394210 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for user cb737cfd514343dfbfbc30816cf5f655 and project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:45:08.812376 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-62cc74af-a2e7-4d15-929f-c11ad4394210 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.163440 May 11 07:45:08.813246 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 357/710] 10.222.0.36 () {60 vars in 1158 bytes} [Wed May 11 07:45:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:45:10.152140 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-37526956", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03fe8424-c7a4-4a16-bd46-5991849ceca4"}], "security_groups": [{"name": "tempest-securitygroup--1314160902"}], "key_name": "tempest-keypair-783081354", "user_data": "}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:45:10.257805 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.network.neutron [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] validate_networks() for [('03fe8424-c7a4-4a16-bd46-5991849ceca4', None, None, None, None, None)] {{(pid=123600) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:45:10.913107 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Flavor limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:45:10.913666 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Image limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:45:10.914209 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Flavor pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:45:10.914615 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Image pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:45:10.915024 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:45:10.925058 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:10.925515 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:10.926359 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:10.926808 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:10.944611 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:45:10.948663 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for user cb737cfd514343dfbfbc30816cf5f655 and project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:45:10.959959 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Going to run 1 instances... {{(pid=123600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:45:10.962289 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:45:11.014571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4c67ffbf-1b01-4270-bda7-20c599ee8f75 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.866605 May 11 07:45:11.015922 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 354/711] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:45:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:45:11.026278 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-670217fd-5126-4617-bbfd-4c457a69d5c6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:11.026881 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-670217fd-5126-4617-bbfd-4c457a69d5c6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:11.082700 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-670217fd-5126-4617-bbfd-4c457a69d5c6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:11.089724 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-670217fd-5126-4617-bbfd-4c457a69d5c6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1239 microversion: 2.1 time: 0.067824 May 11 07:45:11.090266 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 358/712] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:11 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:12.107694 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7357b553-01ba-4e06-bb19-ec60643a9766 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:12.108312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7357b553-01ba-4e06-bb19-ec60643a9766 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:12.115439 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7357b553-01ba-4e06-bb19-ec60643a9766 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:12.115988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7357b553-01ba-4e06-bb19-ec60643a9766 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:12.116841 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7357b553-01ba-4e06-bb19-ec60643a9766 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:12.117289 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7357b553-01ba-4e06-bb19-ec60643a9766 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:12.183471 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7357b553-01ba-4e06-bb19-ec60643a9766 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:12.191933 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7357b553-01ba-4e06-bb19-ec60643a9766 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1243 microversion: 2.1 time: 0.089148 May 11 07:45:12.192510 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 355/713] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:12 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1243 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:13.208805 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-e7298b1f-7409-491e-a3c0-02b510b3e425 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:13.209421 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-e7298b1f-7409-491e-a3c0-02b510b3e425 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:13.215796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e7298b1f-7409-491e-a3c0-02b510b3e425 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:13.216244 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e7298b1f-7409-491e-a3c0-02b510b3e425 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:13.217002 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e7298b1f-7409-491e-a3c0-02b510b3e425 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:13.217434 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e7298b1f-7409-491e-a3c0-02b510b3e425 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:13.276747 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-e7298b1f-7409-491e-a3c0-02b510b3e425 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:13.285855 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-e7298b1f-7409-491e-a3c0-02b510b3e425 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1235 microversion: 2.1 time: 0.080328 May 11 07:45:13.286858 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 359/714] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:13 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1235 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:14.309132 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8f0467f0-545d-4bb5-b091-63eb15981ed5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:14.309762 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8f0467f0-545d-4bb5-b091-63eb15981ed5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:14.316683 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f0467f0-545d-4bb5-b091-63eb15981ed5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:14.317143 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f0467f0-545d-4bb5-b091-63eb15981ed5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:14.317953 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f0467f0-545d-4bb5-b091-63eb15981ed5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:14.318402 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f0467f0-545d-4bb5-b091-63eb15981ed5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:14.414630 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8f0467f0-545d-4bb5-b091-63eb15981ed5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:14.422310 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8f0467f0-545d-4bb5-b091-63eb15981ed5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1297 microversion: 2.1 time: 0.116970 May 11 07:45:14.422876 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 356/715] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:14 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1297 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:15.439941 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c105aaca-ccef-4b38-ae65-e14d2669b24b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:15.440529 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-c105aaca-ccef-4b38-ae65-e14d2669b24b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:15.447740 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c105aaca-ccef-4b38-ae65-e14d2669b24b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:15.448235 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c105aaca-ccef-4b38-ae65-e14d2669b24b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:15.449051 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c105aaca-ccef-4b38-ae65-e14d2669b24b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:15.449786 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c105aaca-ccef-4b38-ae65-e14d2669b24b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:15.465904 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-ecfbd337-0163-4ec3-9b10-3ad072590f7e req-d79e4584-ee78-4f1b-a0c3-0ae875e270f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c09ecce-a2f8-499a-81fc-b35151fdd6b4", "tag": "548f0c13-5720-409d-934a-ad902e0200b1"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:45:15.505270 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-ecfbd337-0163-4ec3-9b10-3ad072590f7e req-d79e4584-ee78-4f1b-a0c3-0ae875e270f3 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:15.506716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-ecfbd337-0163-4ec3-9b10-3ad072590f7e req-d79e4584-ee78-4f1b-a0c3-0ae875e270f3 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:15.521812 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-ecfbd337-0163-4ec3-9b10-3ad072590f7e req-d79e4584-ee78-4f1b-a0c3-0ae875e270f3 service nova] Creating event network-changed:548f0c13-5720-409d-934a-ad902e0200b1 for instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 on hv-cinder-83699 May 11 07:45:15.527201 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-ecfbd337-0163-4ec3-9b10-3ad072590f7e req-d79e4584-ee78-4f1b-a0c3-0ae875e270f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070691 May 11 07:45:15.528020 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 357/716] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:45:15.634092 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-c105aaca-ccef-4b38-ae65-e14d2669b24b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:15.642131 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c105aaca-ccef-4b38-ae65-e14d2669b24b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1365 microversion: 2.1 time: 0.206225 May 11 07:45:15.642695 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 360/717] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:15 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:16.660852 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-342db6be-3dc8-4dce-8b79-607ac17b4ccf tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:16.661693 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-342db6be-3dc8-4dce-8b79-607ac17b4ccf tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:16.668522 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-342db6be-3dc8-4dce-8b79-607ac17b4ccf tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:16.668981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-342db6be-3dc8-4dce-8b79-607ac17b4ccf tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:16.669778 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-342db6be-3dc8-4dce-8b79-607ac17b4ccf tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:16.670218 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-342db6be-3dc8-4dce-8b79-607ac17b4ccf tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:16.793692 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-342db6be-3dc8-4dce-8b79-607ac17b4ccf tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:16.800812 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-342db6be-3dc8-4dce-8b79-607ac17b4ccf tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1365 microversion: 2.1 time: 0.144197 May 11 07:45:16.801372 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 358/718] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:16 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:17.817842 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-9febcffd-68bd-4457-adf2-cfa84ad5d5c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:17.818369 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-9febcffd-68bd-4457-adf2-cfa84ad5d5c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:17.824566 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9febcffd-68bd-4457-adf2-cfa84ad5d5c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:17.825009 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9febcffd-68bd-4457-adf2-cfa84ad5d5c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:17.825800 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9febcffd-68bd-4457-adf2-cfa84ad5d5c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:17.826234 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9febcffd-68bd-4457-adf2-cfa84ad5d5c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:17.947908 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-9febcffd-68bd-4457-adf2-cfa84ad5d5c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:17.955032 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-9febcffd-68bd-4457-adf2-cfa84ad5d5c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1365 microversion: 2.1 time: 0.141417 May 11 07:45:17.955584 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 361/719] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:17 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1365 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:18.971744 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f251585b-2e07-48db-9d2b-82b27ce9d3e9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:18.972445 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f251585b-2e07-48db-9d2b-82b27ce9d3e9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:18.978846 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f251585b-2e07-48db-9d2b-82b27ce9d3e9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:18.979303 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f251585b-2e07-48db-9d2b-82b27ce9d3e9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:18.980072 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f251585b-2e07-48db-9d2b-82b27ce9d3e9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:18.980515 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f251585b-2e07-48db-9d2b-82b27ce9d3e9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:19.103638 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f251585b-2e07-48db-9d2b-82b27ce9d3e9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:19.111271 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f251585b-2e07-48db-9d2b-82b27ce9d3e9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1365 microversion: 2.1 time: 0.143661 May 11 07:45:19.111826 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 359/720] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:18 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:20.127970 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-09f025bc-776b-44c9-b0f3-4fa4c00dcc29 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:20.128531 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-09f025bc-776b-44c9-b0f3-4fa4c00dcc29 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:20.134928 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-09f025bc-776b-44c9-b0f3-4fa4c00dcc29 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:20.135404 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-09f025bc-776b-44c9-b0f3-4fa4c00dcc29 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:20.136170 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-09f025bc-776b-44c9-b0f3-4fa4c00dcc29 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:20.136605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-09f025bc-776b-44c9-b0f3-4fa4c00dcc29 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:20.263500 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-09f025bc-776b-44c9-b0f3-4fa4c00dcc29 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:20.270858 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-09f025bc-776b-44c9-b0f3-4fa4c00dcc29 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1365 microversion: 2.1 time: 0.146912 May 11 07:45:20.271417 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 362/721] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:20 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:21.287464 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-804c7968-7865-4070-8683-9d31f2c4cbf5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:21.288075 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-804c7968-7865-4070-8683-9d31f2c4cbf5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:21.294388 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-804c7968-7865-4070-8683-9d31f2c4cbf5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:21.294842 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-804c7968-7865-4070-8683-9d31f2c4cbf5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:21.295611 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-804c7968-7865-4070-8683-9d31f2c4cbf5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:21.296050 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-804c7968-7865-4070-8683-9d31f2c4cbf5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:21.420886 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-804c7968-7865-4070-8683-9d31f2c4cbf5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:21.428094 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-804c7968-7865-4070-8683-9d31f2c4cbf5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1365 microversion: 2.1 time: 0.144585 May 11 07:45:21.428657 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 360/722] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:21 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:22.445392 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-edb90418-af0c-413e-97eb-ad0165f62418 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:22.446029 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-edb90418-af0c-413e-97eb-ad0165f62418 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:22.452829 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-edb90418-af0c-413e-97eb-ad0165f62418 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:22.453271 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-edb90418-af0c-413e-97eb-ad0165f62418 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:22.454061 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-edb90418-af0c-413e-97eb-ad0165f62418 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:22.454495 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-edb90418-af0c-413e-97eb-ad0165f62418 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:22.577817 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-edb90418-af0c-413e-97eb-ad0165f62418 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:22.584947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-edb90418-af0c-413e-97eb-ad0165f62418 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1365 microversion: 2.1 time: 0.143372 May 11 07:45:22.585505 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 363/723] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:22 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:23.261188 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-0e1e9c84-2f70-4e02-a3cf-b11c03fc68da req-2e8cd3b5-14f0-4ae2-bc75-a3a64d6fa8bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c09ecce-a2f8-499a-81fc-b35151fdd6b4", "name": "network-vif-plugged", "status": "completed", "tag": "548f0c13-5720-409d-934a-ad902e0200b1"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:45:23.270500 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-0e1e9c84-2f70-4e02-a3cf-b11c03fc68da req-2e8cd3b5-14f0-4ae2-bc75-a3a64d6fa8bc service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:23.271113 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-0e1e9c84-2f70-4e02-a3cf-b11c03fc68da req-2e8cd3b5-14f0-4ae2-bc75-a3a64d6fa8bc service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:23.283476 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-0e1e9c84-2f70-4e02-a3cf-b11c03fc68da req-2e8cd3b5-14f0-4ae2-bc75-a3a64d6fa8bc service nova] Creating event network-vif-plugged:548f0c13-5720-409d-934a-ad902e0200b1 for instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 on hv-cinder-83699 May 11 07:45:23.289110 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-0e1e9c84-2f70-4e02-a3cf-b11c03fc68da req-2e8cd3b5-14f0-4ae2-bc75-a3a64d6fa8bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031484 May 11 07:45:23.289948 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 361/724] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:45:23.602261 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-5e5fcf59-f455-4d39-85f6-9a33ef46f44b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:23.602909 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-5e5fcf59-f455-4d39-85f6-9a33ef46f44b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:23.610021 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5e5fcf59-f455-4d39-85f6-9a33ef46f44b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:23.610513 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5e5fcf59-f455-4d39-85f6-9a33ef46f44b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:23.611250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5e5fcf59-f455-4d39-85f6-9a33ef46f44b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:23.611687 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5e5fcf59-f455-4d39-85f6-9a33ef46f44b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:23.784446 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-5e5fcf59-f455-4d39-85f6-9a33ef46f44b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:23.791565 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-5e5fcf59-f455-4d39-85f6-9a33ef46f44b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1365 microversion: 2.1 time: 0.193245 May 11 07:45:23.792125 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 364/725] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:23 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:24.809135 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e781414e-a880-4c95-9880-4b1d8d9afeff tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:24.810413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e781414e-a880-4c95-9880-4b1d8d9afeff tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:24.817346 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e781414e-a880-4c95-9880-4b1d8d9afeff tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:24.817861 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e781414e-a880-4c95-9880-4b1d8d9afeff tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:24.818633 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e781414e-a880-4c95-9880-4b1d8d9afeff tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:24.819065 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e781414e-a880-4c95-9880-4b1d8d9afeff tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:24.954621 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e781414e-a880-4c95-9880-4b1d8d9afeff tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:24.962988 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e781414e-a880-4c95-9880-4b1d8d9afeff tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1365 microversion: 2.1 time: 0.158556 May 11 07:45:24.972778 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 362/726] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:24 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:25.979989 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-473e5ee5-2c94-4b1e-bc79-5523e6f6b49a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:25.980588 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-473e5ee5-2c94-4b1e-bc79-5523e6f6b49a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:25.986869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-473e5ee5-2c94-4b1e-bc79-5523e6f6b49a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:25.987312 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-473e5ee5-2c94-4b1e-bc79-5523e6f6b49a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:25.988064 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-473e5ee5-2c94-4b1e-bc79-5523e6f6b49a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:25.988498 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-473e5ee5-2c94-4b1e-bc79-5523e6f6b49a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:26.124172 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-473e5ee5-2c94-4b1e-bc79-5523e6f6b49a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:26.131997 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-473e5ee5-2c94-4b1e-bc79-5523e6f6b49a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1555 microversion: 2.1 time: 0.155741 May 11 07:45:26.132658 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 365/727] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:25 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:26.149166 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a1574cf3-64c0-45cf-a0b9-7251982d3ea6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:26.149701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a1574cf3-64c0-45cf-a0b9-7251982d3ea6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:26.155894 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a1574cf3-64c0-45cf-a0b9-7251982d3ea6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:26.156357 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a1574cf3-64c0-45cf-a0b9-7251982d3ea6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:26.157138 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a1574cf3-64c0-45cf-a0b9-7251982d3ea6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:26.157600 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a1574cf3-64c0-45cf-a0b9-7251982d3ea6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:26.234694 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a1574cf3-64c0-45cf-a0b9-7251982d3ea6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089207 May 11 07:45:26.235303 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 363/728] 10.222.0.36 () {58 vars in 1274 bytes} [Wed May 11 07:45:26 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:45:27.397161 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-69c04870-bfbc-49f3-b61d-899e30c8a522 req-5f09eea3-52d0-4f22-8f3a-cc94bd398303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c09ecce-a2f8-499a-81fc-b35151fdd6b4", "tag": "548f0c13-5720-409d-934a-ad902e0200b1"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:45:27.406562 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-69c04870-bfbc-49f3-b61d-899e30c8a522 req-5f09eea3-52d0-4f22-8f3a-cc94bd398303 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:27.407010 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-69c04870-bfbc-49f3-b61d-899e30c8a522 req-5f09eea3-52d0-4f22-8f3a-cc94bd398303 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:27.419224 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-69c04870-bfbc-49f3-b61d-899e30c8a522 req-5f09eea3-52d0-4f22-8f3a-cc94bd398303 service nova] Creating event network-changed:548f0c13-5720-409d-934a-ad902e0200b1 for instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 on hv-cinder-83699 May 11 07:45:27.426578 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-69c04870-bfbc-49f3-b61d-899e30c8a522 req-5f09eea3-52d0-4f22-8f3a-cc94bd398303 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030822 May 11 07:45:27.426578 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 366/729] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:45:38.916383 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-68743356", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-678948032", "security_groups": [{"name": "tempest-secgroup-smoke-402851186"}], "block_device_mapping_v2": [{"uuid": "8f0a5017-23f9-4e7e-932e-a555d369d614", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "55b96101-3633-4a8d-a623-73556fb91d7c"}]}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:45:39.023917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.network.neutron [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] validate_networks() for [('55b96101-3633-4a8d-a623-73556fb91d7c', None, None, None, None, None)] {{(pid=123600) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:45:39.389395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Flavor limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:45:39.389874 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Image limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:45:39.390346 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Flavor pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:45:39.390770 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Image pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:45:39.391154 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:45:39.400116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:39.400564 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:39.401357 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:39.401815 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:39.417375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Getting quotas for project d69ae02f1e0146c795d799160ac17d44. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:45:39.421151 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Getting quotas for user ed2dae16f03c4eff9185087ed50120fc and project d69ae02f1e0146c795d799160ac17d44. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:45:39.476214 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Going to run 1 instances... {{(pid=123600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:45:39.478321 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f0a5017-23f9-4e7e-932e-a555d369d614',volume_size=None,volume_type=None)] {{(pid=123600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:45:39.599173 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-47eb806d-4480-4917-8b86-b84d6a21be66 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.687037 May 11 07:45:39.599813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 364/730] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:45:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:45:39.610733 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-078de900-afd4-4cb8-a971-63fff8bd083d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:39.611940 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-078de900-afd4-4cb8-a971-63fff8bd083d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:39.665569 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-078de900-afd4-4cb8-a971-63fff8bd083d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:39.671967 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-078de900-afd4-4cb8-a971-63fff8bd083d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1092 microversion: 2.1 time: 0.065996 May 11 07:45:39.672522 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 367/731] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:39 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1092 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:40.689424 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2dc72c19-34db-4d93-9663-893f20ade323 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:40.690106 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2dc72c19-34db-4d93-9663-893f20ade323 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:40.696862 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2dc72c19-34db-4d93-9663-893f20ade323 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:40.697325 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2dc72c19-34db-4d93-9663-893f20ade323 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:40.698157 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2dc72c19-34db-4d93-9663-893f20ade323 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:40.698597 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2dc72c19-34db-4d93-9663-893f20ade323 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:40.781177 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-2dc72c19-34db-4d93-9663-893f20ade323 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:40.788308 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2dc72c19-34db-4d93-9663-893f20ade323 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1208 microversion: 2.1 time: 0.102684 May 11 07:45:40.788862 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 365/732] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:40 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1208 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:41.804709 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-27a8eecd-a5ca-408d-b64d-8161bfd302be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:41.805384 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-27a8eecd-a5ca-408d-b64d-8161bfd302be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:41.812340 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-27a8eecd-a5ca-408d-b64d-8161bfd302be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:41.813108 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-27a8eecd-a5ca-408d-b64d-8161bfd302be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:41.813939 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-27a8eecd-a5ca-408d-b64d-8161bfd302be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:41.814865 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-27a8eecd-a5ca-408d-b64d-8161bfd302be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:42.001035 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-27a8eecd-a5ca-408d-b64d-8161bfd302be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:42.008828 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-27a8eecd-a5ca-408d-b64d-8161bfd302be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1263 microversion: 2.1 time: 0.208045 May 11 07:45:42.009630 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 368/733] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:41 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1263 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:42.046196 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-ef989499-8c38-428b-bd06-f3358256f050 req-27f8345b-540e-4b87-8684-61ae605778c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf448381-f7a1-48de-b1a3-4c4fff939b95", "tag": "b4036bf3-ceea-472d-ac6d-ec2df0d52432"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:45:42.055564 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-ef989499-8c38-428b-bd06-f3358256f050 req-27f8345b-540e-4b87-8684-61ae605778c8 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:42.056004 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-ef989499-8c38-428b-bd06-f3358256f050 req-27f8345b-540e-4b87-8684-61ae605778c8 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:42.071146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-ef989499-8c38-428b-bd06-f3358256f050 req-27f8345b-540e-4b87-8684-61ae605778c8 service nova] Creating event network-changed:b4036bf3-ceea-472d-ac6d-ec2df0d52432 for instance bf448381-f7a1-48de-b1a3-4c4fff939b95 on hv-cinder-83699 May 11 07:45:42.076200 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-ef989499-8c38-428b-bd06-f3358256f050 req-27f8345b-540e-4b87-8684-61ae605778c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034791 May 11 07:45:42.077177 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 366/734] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:45:43.025472 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-e1fcc887-960a-4438-a8c9-9f19dbb673ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:43.026117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-e1fcc887-960a-4438-a8c9-9f19dbb673ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:43.032419 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e1fcc887-960a-4438-a8c9-9f19dbb673ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:43.032983 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e1fcc887-960a-4438-a8c9-9f19dbb673ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:43.033778 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e1fcc887-960a-4438-a8c9-9f19dbb673ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:43.034224 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e1fcc887-960a-4438-a8c9-9f19dbb673ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:43.225959 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-e1fcc887-960a-4438-a8c9-9f19dbb673ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:43.233225 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-e1fcc887-960a-4438-a8c9-9f19dbb673ea tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1263 microversion: 2.1 time: 0.211576 May 11 07:45:43.233827 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 369/735] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:43 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1263 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:44.250955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-56d08c6f-70c4-4bc8-afbf-4dac29f86154 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:44.251676 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-56d08c6f-70c4-4bc8-afbf-4dac29f86154 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:44.257838 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-56d08c6f-70c4-4bc8-afbf-4dac29f86154 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:44.258287 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-56d08c6f-70c4-4bc8-afbf-4dac29f86154 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:44.259041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-56d08c6f-70c4-4bc8-afbf-4dac29f86154 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:44.259473 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-56d08c6f-70c4-4bc8-afbf-4dac29f86154 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:44.389686 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-56d08c6f-70c4-4bc8-afbf-4dac29f86154 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:44.397433 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-56d08c6f-70c4-4bc8-afbf-4dac29f86154 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1263 microversion: 2.1 time: 0.151099 May 11 07:45:44.398015 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 367/736] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:44 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:45.414535 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-093556e7-bcb0-42d8-8746-1d555b22fb43 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:45.415158 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-093556e7-bcb0-42d8-8746-1d555b22fb43 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:45.421484 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-093556e7-bcb0-42d8-8746-1d555b22fb43 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:45.421972 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-093556e7-bcb0-42d8-8746-1d555b22fb43 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:45.422734 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-093556e7-bcb0-42d8-8746-1d555b22fb43 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:45.423167 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-093556e7-bcb0-42d8-8746-1d555b22fb43 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:45.547937 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-093556e7-bcb0-42d8-8746-1d555b22fb43 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:45.555888 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-093556e7-bcb0-42d8-8746-1d555b22fb43 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1263 microversion: 2.1 time: 0.145187 May 11 07:45:45.556451 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 370/737] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:45 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1263 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:45:46.572351 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-fb60a48b-1d8d-4f7b-9944-ad0b719bda69 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:46.572963 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-fb60a48b-1d8d-4f7b-9944-ad0b719bda69 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:46.579434 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fb60a48b-1d8d-4f7b-9944-ad0b719bda69 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:46.579892 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fb60a48b-1d8d-4f7b-9944-ad0b719bda69 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:46.580662 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fb60a48b-1d8d-4f7b-9944-ad0b719bda69 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:46.581116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fb60a48b-1d8d-4f7b-9944-ad0b719bda69 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:46.708953 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-fb60a48b-1d8d-4f7b-9944-ad0b719bda69 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:46.716147 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-fb60a48b-1d8d-4f7b-9944-ad0b719bda69 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1263 microversion: 2.1 time: 0.147595 May 11 07:45:46.716711 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 368/738] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:46 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:47.733327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a2409059-e208-4d83-84d6-bded4a5f0156 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:47.733964 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a2409059-e208-4d83-84d6-bded4a5f0156 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:47.740275 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a2409059-e208-4d83-84d6-bded4a5f0156 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:47.740728 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a2409059-e208-4d83-84d6-bded4a5f0156 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:47.741492 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a2409059-e208-4d83-84d6-bded4a5f0156 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:47.741959 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a2409059-e208-4d83-84d6-bded4a5f0156 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:47.867444 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a2409059-e208-4d83-84d6-bded4a5f0156 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:47.874702 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a2409059-e208-4d83-84d6-bded4a5f0156 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1263 microversion: 2.1 time: 0.145247 May 11 07:45:47.875275 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 371/739] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:47 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1263 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:48.891842 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4e914ef4-08e7-4886-9056-7d7eee652078 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:48.892864 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4e914ef4-08e7-4886-9056-7d7eee652078 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:48.899080 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4e914ef4-08e7-4886-9056-7d7eee652078 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:48.899532 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4e914ef4-08e7-4886-9056-7d7eee652078 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:48.900286 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4e914ef4-08e7-4886-9056-7d7eee652078 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:48.900717 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4e914ef4-08e7-4886-9056-7d7eee652078 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:49.028943 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4e914ef4-08e7-4886-9056-7d7eee652078 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:49.036160 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4e914ef4-08e7-4886-9056-7d7eee652078 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1263 microversion: 2.1 time: 0.148254 May 11 07:45:49.036724 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 369/740] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:48 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:50.053478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-cdd9b5a3-f903-4271-8478-27688b140e9c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:50.054115 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-cdd9b5a3-f903-4271-8478-27688b140e9c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:50.060378 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cdd9b5a3-f903-4271-8478-27688b140e9c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:50.060817 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cdd9b5a3-f903-4271-8478-27688b140e9c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:50.061602 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cdd9b5a3-f903-4271-8478-27688b140e9c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:50.062030 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cdd9b5a3-f903-4271-8478-27688b140e9c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:50.194811 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-cdd9b5a3-f903-4271-8478-27688b140e9c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:50.201976 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-cdd9b5a3-f903-4271-8478-27688b140e9c tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1263 microversion: 2.1 time: 0.152282 May 11 07:45:50.202536 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 372/741] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:50 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:51.220764 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e989f308-aa2e-460a-bb20-256efcf23561 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:51.221446 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e989f308-aa2e-460a-bb20-256efcf23561 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:51.229597 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e989f308-aa2e-460a-bb20-256efcf23561 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:51.230049 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e989f308-aa2e-460a-bb20-256efcf23561 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:51.231324 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e989f308-aa2e-460a-bb20-256efcf23561 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:51.232075 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e989f308-aa2e-460a-bb20-256efcf23561 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:51.362120 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e989f308-aa2e-460a-bb20-256efcf23561 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:51.369357 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e989f308-aa2e-460a-bb20-256efcf23561 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1263 microversion: 2.1 time: 0.153667 May 11 07:45:51.369959 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 370/742] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:51 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:52.385959 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d535b03a-f25c-4643-aa10-f3918d1fed5d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:52.386561 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d535b03a-f25c-4643-aa10-f3918d1fed5d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:52.392817 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d535b03a-f25c-4643-aa10-f3918d1fed5d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:52.393260 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d535b03a-f25c-4643-aa10-f3918d1fed5d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:52.394036 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d535b03a-f25c-4643-aa10-f3918d1fed5d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:52.394466 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d535b03a-f25c-4643-aa10-f3918d1fed5d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:52.522108 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d535b03a-f25c-4643-aa10-f3918d1fed5d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:52.529382 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d535b03a-f25c-4643-aa10-f3918d1fed5d tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1263 microversion: 2.1 time: 0.147220 May 11 07:45:52.529965 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 373/743] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:52 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:52.906350 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-f395d97b-2eab-445d-9a2a-729ef9c07f53 req-afeac735-44b4-4236-a651-4951055a4128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf448381-f7a1-48de-b1a3-4c4fff939b95", "name": "network-vif-plugged", "status": "completed", "tag": "b4036bf3-ceea-472d-ac6d-ec2df0d52432"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:45:52.915205 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-f395d97b-2eab-445d-9a2a-729ef9c07f53 req-afeac735-44b4-4236-a651-4951055a4128 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:52.915646 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-f395d97b-2eab-445d-9a2a-729ef9c07f53 req-afeac735-44b4-4236-a651-4951055a4128 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:52.927239 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-f395d97b-2eab-445d-9a2a-729ef9c07f53 req-afeac735-44b4-4236-a651-4951055a4128 service nova] Creating event network-vif-plugged:b4036bf3-ceea-472d-ac6d-ec2df0d52432 for instance bf448381-f7a1-48de-b1a3-4c4fff939b95 on hv-cinder-83699 May 11 07:45:52.932183 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-f395d97b-2eab-445d-9a2a-729ef9c07f53 req-afeac735-44b4-4236-a651-4951055a4128 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029336 May 11 07:45:52.932759 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 371/744] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:45:53.545772 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-de1619b5-fd4d-461a-a67d-b006f129b477 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:53.546388 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-de1619b5-fd4d-461a-a67d-b006f129b477 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:53.553009 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-de1619b5-fd4d-461a-a67d-b006f129b477 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:53.553458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-de1619b5-fd4d-461a-a67d-b006f129b477 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:53.554242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-de1619b5-fd4d-461a-a67d-b006f129b477 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:53.554700 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-de1619b5-fd4d-461a-a67d-b006f129b477 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:53.683418 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-de1619b5-fd4d-461a-a67d-b006f129b477 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:53.691413 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-de1619b5-fd4d-461a-a67d-b006f129b477 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1263 microversion: 2.1 time: 0.149782 May 11 07:45:53.691985 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 374/745] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:53 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:54.709696 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e6589b97-a875-4e7a-862b-6ea5354d28c4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:54.710387 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e6589b97-a875-4e7a-862b-6ea5354d28c4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:54.716555 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e6589b97-a875-4e7a-862b-6ea5354d28c4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:54.717018 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e6589b97-a875-4e7a-862b-6ea5354d28c4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:54.717808 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e6589b97-a875-4e7a-862b-6ea5354d28c4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:54.718328 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e6589b97-a875-4e7a-862b-6ea5354d28c4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:54.850055 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e6589b97-a875-4e7a-862b-6ea5354d28c4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:54.857814 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e6589b97-a875-4e7a-862b-6ea5354d28c4 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1263 microversion: 2.1 time: 0.153233 May 11 07:45:54.867438 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 372/746] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:54 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:55.874314 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-81476cd6-bca1-4947-8996-cd6471cb2a6b tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:55.874919 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-81476cd6-bca1-4947-8996-cd6471cb2a6b tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:55.881193 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-81476cd6-bca1-4947-8996-cd6471cb2a6b tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:55.881671 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-81476cd6-bca1-4947-8996-cd6471cb2a6b tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:55.882430 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-81476cd6-bca1-4947-8996-cd6471cb2a6b tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:55.882863 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-81476cd6-bca1-4947-8996-cd6471cb2a6b tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:56.013706 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-81476cd6-bca1-4947-8996-cd6471cb2a6b tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:56.021480 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-81476cd6-bca1-4947-8996-cd6471cb2a6b tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1450 microversion: 2.1 time: 0.150994 May 11 07:45:56.022159 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 375/747] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:55 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:56.038275 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-124011fa-47af-401d-8956-747181daf875 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:45:56.038888 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-124011fa-47af-401d-8956-747181daf875 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:45:56.045109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-124011fa-47af-401d-8956-747181daf875 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:56.045592 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-124011fa-47af-401d-8956-747181daf875 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:56.046363 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-124011fa-47af-401d-8956-747181daf875 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:56.046802 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-124011fa-47af-401d-8956-747181daf875 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:56.184058 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-124011fa-47af-401d-8956-747181daf875 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:45:56.191666 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-124011fa-47af-401d-8956-747181daf875 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1450 microversion: 2.1 time: 0.157096 May 11 07:45:56.192221 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 373/748] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:45:56 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:45:57.811252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-068e2b36-dd74-4681-b63f-25cf1164d439 req-49728092-5506-4a5a-b132-764a14890734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf448381-f7a1-48de-b1a3-4c4fff939b95", "tag": "b4036bf3-ceea-472d-ac6d-ec2df0d52432"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:45:57.819850 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-068e2b36-dd74-4681-b63f-25cf1164d439 req-49728092-5506-4a5a-b132-764a14890734 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:45:57.820365 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-068e2b36-dd74-4681-b63f-25cf1164d439 req-49728092-5506-4a5a-b132-764a14890734 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:45:57.831430 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-068e2b36-dd74-4681-b63f-25cf1164d439 req-49728092-5506-4a5a-b132-764a14890734 service nova] Creating event network-changed:b4036bf3-ceea-472d-ac6d-ec2df0d52432 for instance bf448381-f7a1-48de-b1a3-4c4fff939b95 on hv-cinder-83699 May 11 07:45:57.836575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-068e2b36-dd74-4681-b63f-25cf1164d439 req-49728092-5506-4a5a-b132-764a14890734 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028980 May 11 07:45:57.837184 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 376/749] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:46:02.744582 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1616737445", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "networks": [{"uuid": "613e8e93-9a8d-41a7-94ab-6469f95f81a6"}]}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:46:02.793889 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.network.neutron [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] validate_networks() for [('613e8e93-9a8d-41a7-94ab-6469f95f81a6', None, None, None, None, None)] {{(pid=123600) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:46:03.401410 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Flavor limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:46:03.401854 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Image limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:46:03.402330 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Flavor pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:46:03.402735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Image pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:46:03.403146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:46:03.411588 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:03.412034 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:03.412839 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:03.413277 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:03.429098 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Getting quotas for project 0c4410fd6b2c46da89537b4923db6d89. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:46:03.432893 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Getting quotas for user e1b0351ac4564043b97f5499679cdc06 and project 0c4410fd6b2c46da89537b4923db6d89. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:46:03.444093 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Going to run 1 instances... {{(pid=123600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:46:03.446307 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:46:03.490012 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2c79348f-a7e1-4b96-b382-b2607cb68829 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749144 May 11 07:46:03.490660 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 374/750] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:46:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:46:03.501918 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-5141d36f-fed1-42b4-a2d8-6698be1b34a4 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:03.502623 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-5141d36f-fed1-42b4-a2d8-6698be1b34a4 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:03.554454 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-5141d36f-fed1-42b4-a2d8-6698be1b34a4 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:03.560962 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-5141d36f-fed1-42b4-a2d8-6698be1b34a4 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15" status: 200 len: 1219 microversion: 2.1 time: 0.064168 May 11 07:46:03.561556 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 377/751] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:03 2022] GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:46:04.578116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-12b52eff-d6da-4b1d-9945-daa81262e5ae tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:04.578723 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-12b52eff-d6da-4b1d-9945-daa81262e5ae tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:04.586171 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-12b52eff-d6da-4b1d-9945-daa81262e5ae tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:04.586624 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-12b52eff-d6da-4b1d-9945-daa81262e5ae tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:04.587375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-12b52eff-d6da-4b1d-9945-daa81262e5ae tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:04.587811 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-12b52eff-d6da-4b1d-9945-daa81262e5ae tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:04.659348 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-12b52eff-d6da-4b1d-9945-daa81262e5ae tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:04.666810 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-12b52eff-d6da-4b1d-9945-daa81262e5ae tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15" status: 200 len: 1277 microversion: 2.1 time: 0.092520 May 11 07:46:04.667776 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 375/752] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:04 2022] GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:05.684444 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-03060685-d882-4eea-ab86-11a534a9d69d tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:05.685688 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-03060685-d882-4eea-ab86-11a534a9d69d tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:05.688659 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-e1b53e79-6d8a-425b-9a87-f32446ebcd7a req-87436afd-be40-4f26-bbf3-a5dde4b5735b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ed5625-305f-4088-b62a-1bd2e26f8b15", "tag": "63b76a94-0623-4bf6-a405-6a029e1a42a8"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:46:05.695283 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-03060685-d882-4eea-ab86-11a534a9d69d tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:05.696005 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-03060685-d882-4eea-ab86-11a534a9d69d tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:05.697614 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-03060685-d882-4eea-ab86-11a534a9d69d tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:05.698286 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-03060685-d882-4eea-ab86-11a534a9d69d tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:05.703855 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-e1b53e79-6d8a-425b-9a87-f32446ebcd7a req-87436afd-be40-4f26-bbf3-a5dde4b5735b service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:05.704422 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-e1b53e79-6d8a-425b-9a87-f32446ebcd7a req-87436afd-be40-4f26-bbf3-a5dde4b5735b service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:05.717212 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-e1b53e79-6d8a-425b-9a87-f32446ebcd7a req-87436afd-be40-4f26-bbf3-a5dde4b5735b service nova] Creating event network-changed:63b76a94-0623-4bf6-a405-6a029e1a42a8 for instance 00ed5625-305f-4088-b62a-1bd2e26f8b15 on hv-cinder-83699 May 11 07:46:05.723303 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-e1b53e79-6d8a-425b-9a87-f32446ebcd7a req-87436afd-be40-4f26-bbf3-a5dde4b5735b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040704 May 11 07:46:05.724161 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 376/753] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:46:05.914132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-03060685-d882-4eea-ab86-11a534a9d69d tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:05.921433 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-03060685-d882-4eea-ab86-11a534a9d69d tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15" status: 200 len: 1319 microversion: 2.1 time: 0.241065 May 11 07:46:05.921959 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 378/754] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:05 2022] GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:06.938236 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-bfa14cbc-7285-43da-ac2a-894f372b9c8b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:06.939534 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-bfa14cbc-7285-43da-ac2a-894f372b9c8b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:06.946473 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bfa14cbc-7285-43da-ac2a-894f372b9c8b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:06.946926 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bfa14cbc-7285-43da-ac2a-894f372b9c8b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:06.947697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bfa14cbc-7285-43da-ac2a-894f372b9c8b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:06.948136 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-bfa14cbc-7285-43da-ac2a-894f372b9c8b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:07.167079 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-bfa14cbc-7285-43da-ac2a-894f372b9c8b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:07.175161 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-bfa14cbc-7285-43da-ac2a-894f372b9c8b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15" status: 200 len: 1319 microversion: 2.1 time: 0.241168 May 11 07:46:07.175735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 377/755] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:06 2022] GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:08.195954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d2d00706-4ef0-4055-ad3c-37f651f0ce32 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:08.196663 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d2d00706-4ef0-4055-ad3c-37f651f0ce32 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:08.203927 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d2d00706-4ef0-4055-ad3c-37f651f0ce32 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:08.204652 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d2d00706-4ef0-4055-ad3c-37f651f0ce32 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:08.205957 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d2d00706-4ef0-4055-ad3c-37f651f0ce32 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:08.206579 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d2d00706-4ef0-4055-ad3c-37f651f0ce32 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:08.351204 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d2d00706-4ef0-4055-ad3c-37f651f0ce32 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:08.361480 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d2d00706-4ef0-4055-ad3c-37f651f0ce32 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15" status: 200 len: 1319 microversion: 2.1 time: 0.170700 May 11 07:46:08.362088 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 379/756] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:08 2022] GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:09.378407 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f73439a1-6de9-4ccd-a10f-008472e8052a tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:09.378927 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f73439a1-6de9-4ccd-a10f-008472e8052a tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:09.385413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f73439a1-6de9-4ccd-a10f-008472e8052a tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:09.385901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f73439a1-6de9-4ccd-a10f-008472e8052a tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:09.386673 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f73439a1-6de9-4ccd-a10f-008472e8052a tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:09.387118 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f73439a1-6de9-4ccd-a10f-008472e8052a tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:09.519962 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f73439a1-6de9-4ccd-a10f-008472e8052a tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:09.527215 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f73439a1-6de9-4ccd-a10f-008472e8052a tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15" status: 200 len: 1319 microversion: 2.1 time: 0.153248 May 11 07:46:09.527782 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 378/757] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:09 2022] GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:09.906222 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-693800f1-3022-47f6-a317-4be178e76c8b req-d300bf96-915a-479b-aca1-ee7b937e2aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ed5625-305f-4088-b62a-1bd2e26f8b15", "name": "network-vif-plugged", "status": "completed", "tag": "63b76a94-0623-4bf6-a405-6a029e1a42a8"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:46:09.915004 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-693800f1-3022-47f6-a317-4be178e76c8b req-d300bf96-915a-479b-aca1-ee7b937e2aac service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:09.915448 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-693800f1-3022-47f6-a317-4be178e76c8b req-d300bf96-915a-479b-aca1-ee7b937e2aac service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:09.928064 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-693800f1-3022-47f6-a317-4be178e76c8b req-d300bf96-915a-479b-aca1-ee7b937e2aac service nova] Creating event network-vif-plugged:63b76a94-0623-4bf6-a405-6a029e1a42a8 for instance 00ed5625-305f-4088-b62a-1bd2e26f8b15 on hv-cinder-83699 May 11 07:46:09.932833 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-693800f1-3022-47f6-a317-4be178e76c8b req-d300bf96-915a-479b-aca1-ee7b937e2aac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030301 May 11 07:46:09.933417 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 380/758] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:46:10.544096 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8f6f378e-3e9f-4951-bb33-5f74d8383dd3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:10.544703 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8f6f378e-3e9f-4951-bb33-5f74d8383dd3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:10.551018 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f6f378e-3e9f-4951-bb33-5f74d8383dd3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:10.551462 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f6f378e-3e9f-4951-bb33-5f74d8383dd3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:10.552216 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f6f378e-3e9f-4951-bb33-5f74d8383dd3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:10.552648 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8f6f378e-3e9f-4951-bb33-5f74d8383dd3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:10.678814 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8f6f378e-3e9f-4951-bb33-5f74d8383dd3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:10.685836 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8f6f378e-3e9f-4951-bb33-5f74d8383dd3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15" status: 200 len: 1319 microversion: 2.1 time: 0.145544 May 11 07:46:10.686392 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 379/759] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:10 2022] GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:11.703666 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-20dba4aa-1e8a-4a79-91b5-c8e1e2a1ed03 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:11.704410 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-20dba4aa-1e8a-4a79-91b5-c8e1e2a1ed03 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:11.710983 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-20dba4aa-1e8a-4a79-91b5-c8e1e2a1ed03 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:11.711431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-20dba4aa-1e8a-4a79-91b5-c8e1e2a1ed03 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:11.712202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-20dba4aa-1e8a-4a79-91b5-c8e1e2a1ed03 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:11.712634 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-20dba4aa-1e8a-4a79-91b5-c8e1e2a1ed03 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:11.846978 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-20dba4aa-1e8a-4a79-91b5-c8e1e2a1ed03 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:11.854194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-20dba4aa-1e8a-4a79-91b5-c8e1e2a1ed03 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15" status: 200 len: 1509 microversion: 2.1 time: 0.155247 May 11 07:46:11.854756 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 381/760] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:11 2022] GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:12.160146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b8ea1ca0-dbce-4762-9c46-397a352b6f24 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:12.160696 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-b8ea1ca0-dbce-4762-9c46-397a352b6f24 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:12.167016 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b8ea1ca0-dbce-4762-9c46-397a352b6f24 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:12.167440 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b8ea1ca0-dbce-4762-9c46-397a352b6f24 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:12.168207 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b8ea1ca0-dbce-4762-9c46-397a352b6f24 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:12.168691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b8ea1ca0-dbce-4762-9c46-397a352b6f24 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:12.195956 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-b8ea1ca0-dbce-4762-9c46-397a352b6f24 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/ips" status: 200 len: 149 microversion: 2.1 time: 0.036514 May 11 07:46:12.195956 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 380/761] 10.222.0.36 () {58 vars in 1247 bytes} [Wed May 11 07:46:12 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:46:13.550051 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ef38a024-8b4a-467c-bba3-12a7b672ced7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a46f544-6bca-4f43-96b3-1415284986c5"}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:46:13.551108 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ef38a024-8b4a-467c-bba3-12a7b672ced7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:13.557484 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef38a024-8b4a-467c-bba3-12a7b672ced7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:13.558110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef38a024-8b4a-467c-bba3-12a7b672ced7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:13.558992 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef38a024-8b4a-467c-bba3-12a7b672ced7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:13.559436 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ef38a024-8b4a-467c-bba3-12a7b672ced7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:13.799427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ef38a024-8b4a-467c-bba3-12a7b672ced7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "POST /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253102 May 11 07:46:13.802618 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 382/762] 10.222.0.36 () {60 vars in 1322 bytes} [Wed May 11 07:46:13 2022] POST /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:46:21.285695 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5d703a78-ec3b-4ff2-9d24-d80d6c1d14bb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Action: 'create', calling method: .version_select at 0x7f19ec7abee0>, body: {"keypair": {"name": "tempest-keypair-1822374800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnuw1set/KlbE+p29x5zOEhhYXWGskEbWRmSlGnzcWlv4c9ktOHpfsLt6k2XbZTVYvL0jXfkRrwoZbI1uxN2kTzoQGPyu60GFS5OpeegnDRxtNH6s/NIU6o2QBJlUzzYw=="}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:46:21.301726 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-5d703a78-ec3b-4ff2-9d24-d80d6c1d14bb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'key_pairs'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:46:21.305425 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-5d703a78-ec3b-4ff2-9d24-d80d6c1d14bb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for user cb737cfd514343dfbfbc30816cf5f655 and project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'key_pairs'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:46:21.326697 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-5d703a78-ec3b-4ff2-9d24-d80d6c1d14bb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045257 May 11 07:46:21.327285 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 381/763] 10.222.0.36 () {60 vars in 1158 bytes} [Wed May 11 07:46:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:46:22.616342 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-246824605", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03fe8424-c7a4-4a16-bd46-5991849ceca4"}], "security_groups": [{"name": "tempest-securitygroup--1654246253"}], "key_name": "tempest-keypair-1822374800", "user_data": "}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:46:22.714417 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.network.neutron [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] validate_networks() for [('03fe8424-c7a4-4a16-bd46-5991849ceca4', None, None, None, None, None)] {{(pid=123599) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:46:23.115802 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Flavor limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:46:23.116224 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Image limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:46:23.116696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Flavor pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:46:23.117101 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Image pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:46:23.117509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:46:23.125955 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:23.126402 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:23.127779 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:23.128217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:23.144054 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:46:23.147882 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for user cb737cfd514343dfbfbc30816cf5f655 and project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:46:23.158432 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Going to run 1 instances... {{(pid=123599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:46:23.160729 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:46:23.208346 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-84599e06-2fe3-4fb0-8470-fd5dbb6c9b53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.597129 May 11 07:46:23.208989 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 383/764] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:46:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:46:23.219347 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-eca4ddec-5c37-4d66-b97d-782dd141a277 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:23.219952 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-eca4ddec-5c37-4d66-b97d-782dd141a277 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:23.276547 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-eca4ddec-5c37-4d66-b97d-782dd141a277 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:23.283739 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-eca4ddec-5c37-4d66-b97d-782dd141a277 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 200 len: 1241 microversion: 2.1 time: 0.068651 May 11 07:46:23.284296 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 382/765] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:23 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:24.300063 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0d33adbf-260f-4084-b164-767fb9950e6c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:24.300675 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0d33adbf-260f-4084-b164-767fb9950e6c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:24.307901 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0d33adbf-260f-4084-b164-767fb9950e6c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:24.308347 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0d33adbf-260f-4084-b164-767fb9950e6c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:24.309113 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0d33adbf-260f-4084-b164-767fb9950e6c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:24.309532 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0d33adbf-260f-4084-b164-767fb9950e6c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:24.369455 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0d33adbf-260f-4084-b164-767fb9950e6c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:24.378067 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0d33adbf-260f-4084-b164-767fb9950e6c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 200 len: 1299 microversion: 2.1 time: 0.081710 May 11 07:46:24.378789 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 384/766] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:24 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:25.395126 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4a517d5f-1fe1-458b-9aaa-3edba57f0214 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:25.396043 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4a517d5f-1fe1-458b-9aaa-3edba57f0214 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:25.403675 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4a517d5f-1fe1-458b-9aaa-3edba57f0214 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:25.404142 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4a517d5f-1fe1-458b-9aaa-3edba57f0214 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:25.405010 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4a517d5f-1fe1-458b-9aaa-3edba57f0214 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:25.405593 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4a517d5f-1fe1-458b-9aaa-3edba57f0214 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:25.617168 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4a517d5f-1fe1-458b-9aaa-3edba57f0214 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:25.627485 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4a517d5f-1fe1-458b-9aaa-3edba57f0214 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 200 len: 1367 microversion: 2.1 time: 0.235606 May 11 07:46:25.628054 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 383/767] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:25 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:46:25.642226 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-6f6162ae-b769-468f-b3d3-1a83f3c60df2 req-b00d619e-9024-4fa2-87d0-5f18c6b4f8da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb54010c-43ca-4040-8312-da1d47697fa0", "tag": "7650d3c7-12fe-44ab-bafa-6392cb592348"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:46:25.652144 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-6f6162ae-b769-468f-b3d3-1a83f3c60df2 req-b00d619e-9024-4fa2-87d0-5f18c6b4f8da service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:25.652652 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-6f6162ae-b769-468f-b3d3-1a83f3c60df2 req-b00d619e-9024-4fa2-87d0-5f18c6b4f8da service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:25.664784 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-6f6162ae-b769-468f-b3d3-1a83f3c60df2 req-b00d619e-9024-4fa2-87d0-5f18c6b4f8da service nova] Creating event network-changed:7650d3c7-12fe-44ab-bafa-6392cb592348 for instance eb54010c-43ca-4040-8312-da1d47697fa0 on hv-cinder-83699 May 11 07:46:25.670197 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-6f6162ae-b769-468f-b3d3-1a83f3c60df2 req-b00d619e-9024-4fa2-87d0-5f18c6b4f8da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035715 May 11 07:46:25.671157 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 385/768] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:46:26.644645 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-29e8e10d-9adb-45b6-937d-e04161882475 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:26.645253 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-29e8e10d-9adb-45b6-937d-e04161882475 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:26.651741 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-29e8e10d-9adb-45b6-937d-e04161882475 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:26.652193 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-29e8e10d-9adb-45b6-937d-e04161882475 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:26.652952 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-29e8e10d-9adb-45b6-937d-e04161882475 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:26.653382 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-29e8e10d-9adb-45b6-937d-e04161882475 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:26.779727 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-29e8e10d-9adb-45b6-937d-e04161882475 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:26.786829 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-29e8e10d-9adb-45b6-937d-e04161882475 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 200 len: 1367 microversion: 2.1 time: 0.146689 May 11 07:46:26.787382 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 384/769] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:26 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:27.804136 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-53c5729e-5627-4312-b052-816d2fc864ba tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:27.804830 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-53c5729e-5627-4312-b052-816d2fc864ba tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:27.810963 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-53c5729e-5627-4312-b052-816d2fc864ba tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:27.811417 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-53c5729e-5627-4312-b052-816d2fc864ba tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:27.812186 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-53c5729e-5627-4312-b052-816d2fc864ba tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:27.812629 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-53c5729e-5627-4312-b052-816d2fc864ba tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:27.941984 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-53c5729e-5627-4312-b052-816d2fc864ba tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:27.949760 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-53c5729e-5627-4312-b052-816d2fc864ba tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 200 len: 1367 microversion: 2.1 time: 0.150159 May 11 07:46:27.950288 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 386/770] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:27 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:28.966990 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d1116cbc-ad8d-4850-a365-f1ded23263b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:28.967593 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d1116cbc-ad8d-4850-a365-f1ded23263b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:28.973954 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d1116cbc-ad8d-4850-a365-f1ded23263b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:28.974403 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d1116cbc-ad8d-4850-a365-f1ded23263b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:28.975174 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d1116cbc-ad8d-4850-a365-f1ded23263b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:28.975692 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d1116cbc-ad8d-4850-a365-f1ded23263b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:29.030366 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b01c8de5-bb3b-49fa-b796-2a215cb21a20 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4efa526b-e356-4782-851f-7f36aee30898", "device": "/dev/sdb"}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:46:29.031911 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-b01c8de5-bb3b-49fa-b796-2a215cb21a20 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:29.038090 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b01c8de5-bb3b-49fa-b796-2a215cb21a20 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:29.038536 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b01c8de5-bb3b-49fa-b796-2a215cb21a20 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:29.039305 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b01c8de5-bb3b-49fa-b796-2a215cb21a20 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:29.039736 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b01c8de5-bb3b-49fa-b796-2a215cb21a20 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:29.110013 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d1116cbc-ad8d-4850-a365-f1ded23263b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:29.117727 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d1116cbc-ad8d-4850-a365-f1ded23263b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 200 len: 1367 microversion: 2.1 time: 0.154584 May 11 07:46:29.118323 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 385/771] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:28 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:29.262713 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-b01c8de5-bb3b-49fa-b796-2a215cb21a20 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "POST /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.236059 May 11 07:46:29.263371 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 387/772] 10.222.0.36 () {60 vars in 1322 bytes} [Wed May 11 07:46:29 2022] POST /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15/os-volume_attachments => generated 194 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:46:30.134971 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f089c2ad-2354-479c-9c2b-dfb7cf760fe2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:30.135577 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f089c2ad-2354-479c-9c2b-dfb7cf760fe2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:30.142247 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f089c2ad-2354-479c-9c2b-dfb7cf760fe2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:30.142716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f089c2ad-2354-479c-9c2b-dfb7cf760fe2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:30.143459 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f089c2ad-2354-479c-9c2b-dfb7cf760fe2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:30.143892 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f089c2ad-2354-479c-9c2b-dfb7cf760fe2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:30.161479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-abad8873-2cf6-4a55-bc77-fc2d5bd3dae2 req-49b1e4d6-1d54-4d86-a756-679891052780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb54010c-43ca-4040-8312-da1d47697fa0", "name": "network-vif-plugged", "status": "completed", "tag": "7650d3c7-12fe-44ab-bafa-6392cb592348"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:46:30.171969 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-abad8873-2cf6-4a55-bc77-fc2d5bd3dae2 req-49b1e4d6-1d54-4d86-a756-679891052780 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:30.172821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-abad8873-2cf6-4a55-bc77-fc2d5bd3dae2 req-49b1e4d6-1d54-4d86-a756-679891052780 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:30.185982 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-abad8873-2cf6-4a55-bc77-fc2d5bd3dae2 req-49b1e4d6-1d54-4d86-a756-679891052780 service nova] Creating event network-vif-plugged:7650d3c7-12fe-44ab-bafa-6392cb592348 for instance eb54010c-43ca-4040-8312-da1d47697fa0 on hv-cinder-83699 May 11 07:46:30.191805 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-abad8873-2cf6-4a55-bc77-fc2d5bd3dae2 req-49b1e4d6-1d54-4d86-a756-679891052780 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035145 May 11 07:46:30.192642 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 388/773] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:46:30.294547 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f089c2ad-2354-479c-9c2b-dfb7cf760fe2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:30.303516 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f089c2ad-2354-479c-9c2b-dfb7cf760fe2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 200 len: 1367 microversion: 2.1 time: 0.172223 May 11 07:46:30.304090 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 386/774] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:30 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:31.320770 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-9a33126d-d2ce-4f3c-91d3-135a72c49985 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:31.321455 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-9a33126d-d2ce-4f3c-91d3-135a72c49985 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:31.327915 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9a33126d-d2ce-4f3c-91d3-135a72c49985 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:31.328359 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9a33126d-d2ce-4f3c-91d3-135a72c49985 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:31.329108 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9a33126d-d2ce-4f3c-91d3-135a72c49985 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:31.330236 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9a33126d-d2ce-4f3c-91d3-135a72c49985 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:31.468532 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-9a33126d-d2ce-4f3c-91d3-135a72c49985 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:31.476318 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-9a33126d-d2ce-4f3c-91d3-135a72c49985 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 200 len: 1367 microversion: 2.1 time: 0.159691 May 11 07:46:31.476891 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 389/775] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:31 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:32.491936 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4bb5578f-1159-4e8d-aab7-ad7347bdaf9d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:32.492537 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4bb5578f-1159-4e8d-aab7-ad7347bdaf9d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:32.498757 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4bb5578f-1159-4e8d-aab7-ad7347bdaf9d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:32.499204 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4bb5578f-1159-4e8d-aab7-ad7347bdaf9d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:32.499957 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4bb5578f-1159-4e8d-aab7-ad7347bdaf9d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:32.500389 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4bb5578f-1159-4e8d-aab7-ad7347bdaf9d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:32.622380 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4bb5578f-1159-4e8d-aab7-ad7347bdaf9d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:32.630042 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4bb5578f-1159-4e8d-aab7-ad7347bdaf9d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 200 len: 1557 microversion: 2.1 time: 0.141855 May 11 07:46:32.630598 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 387/776] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:32 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 1557 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:32.646597 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-929355de-2085-4e22-9513-edcf287b64ad tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:32.647099 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-929355de-2085-4e22-9513-edcf287b64ad tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:32.653696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-929355de-2085-4e22-9513-edcf287b64ad tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:32.654139 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-929355de-2085-4e22-9513-edcf287b64ad tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:32.654904 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-929355de-2085-4e22-9513-edcf287b64ad tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:32.655519 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-929355de-2085-4e22-9513-edcf287b64ad tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:32.732437 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-929355de-2085-4e22-9513-edcf287b64ad tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090315 May 11 07:46:32.733037 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 390/777] 10.222.0.36 () {58 vars in 1274 bytes} [Wed May 11 07:46:32 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:46:34.326720 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-c0af95e7-7275-40b2-b6ee-e3ebb2566598 req-a35c79a2-a4ca-4c82-919a-64171d9e265f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb54010c-43ca-4040-8312-da1d47697fa0", "tag": "7650d3c7-12fe-44ab-bafa-6392cb592348"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:46:34.335949 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-c0af95e7-7275-40b2-b6ee-e3ebb2566598 req-a35c79a2-a4ca-4c82-919a-64171d9e265f service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:34.336482 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-c0af95e7-7275-40b2-b6ee-e3ebb2566598 req-a35c79a2-a4ca-4c82-919a-64171d9e265f service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:34.349236 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-c0af95e7-7275-40b2-b6ee-e3ebb2566598 req-a35c79a2-a4ca-4c82-919a-64171d9e265f service nova] Creating event network-changed:7650d3c7-12fe-44ab-bafa-6392cb592348 for instance eb54010c-43ca-4040-8312-da1d47697fa0 on hv-cinder-83699 May 11 07:46:34.354201 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-c0af95e7-7275-40b2-b6ee-e3ebb2566598 req-a35c79a2-a4ca-4c82-919a-64171d9e265f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031024 May 11 07:46:34.355093 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 388/778] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:46:52.843351 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-fb24637d-c860-4cee-9e4e-dd589d4c9a01 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:52.844183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-fb24637d-c860-4cee-9e4e-dd589d4c9a01 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:52.850807 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fb24637d-c860-4cee-9e4e-dd589d4c9a01 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:52.851250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fb24637d-c860-4cee-9e4e-dd589d4c9a01 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:52.852025 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fb24637d-c860-4cee-9e4e-dd589d4c9a01 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:52.852477 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fb24637d-c860-4cee-9e4e-dd589d4c9a01 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:52.931094 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.objects.instance [None req-fb24637d-c860-4cee-9e4e-dd589d4c9a01 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lazy-loading 'services' on Instance uuid 00ed5625-305f-4088-b62a-1bd2e26f8b15 {{(pid=123599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:46:52.999855 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-fb24637d-c860-4cee-9e4e-dd589d4c9a01 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "DELETE /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15/os-volume_attachments/4efa526b-e356-4782-851f-7f36aee30898" status: 202 len: 0 microversion: 2.1 time: 0.160685 May 11 07:46:53.000547 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 391/779] 10.222.0.36 () {58 vars in 1415 bytes} [Wed May 11 07:46:52 2022] DELETE /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15/os-volume_attachments/4efa526b-e356-4782-851f-7f36aee30898 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:46:54.112186 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3f5afa52-d636-446e-9631-dc588cde5df6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:54.112763 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3f5afa52-d636-446e-9631-dc588cde5df6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:54.118812 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3f5afa52-d636-446e-9631-dc588cde5df6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:54.119256 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3f5afa52-d636-446e-9631-dc588cde5df6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:54.120014 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3f5afa52-d636-446e-9631-dc588cde5df6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:54.120446 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3f5afa52-d636-446e-9631-dc588cde5df6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:54.144899 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3f5afa52-d636-446e-9631-dc588cde5df6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Going to try to terminate instance {{(pid=123600) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:46:54.219535 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3f5afa52-d636-446e-9631-dc588cde5df6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "DELETE /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15" status: 204 len: 0 microversion: 2.1 time: 0.111429 May 11 07:46:54.220242 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 389/780] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:46:54 2022] DELETE /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:46:54.230240 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c60f66a4-7c8b-4aca-85e9-81bb6fdf114c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:54.231124 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-c60f66a4-7c8b-4aca-85e9-81bb6fdf114c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:54.237211 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c60f66a4-7c8b-4aca-85e9-81bb6fdf114c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:54.237719 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c60f66a4-7c8b-4aca-85e9-81bb6fdf114c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:54.238490 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c60f66a4-7c8b-4aca-85e9-81bb6fdf114c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:54.238927 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c60f66a4-7c8b-4aca-85e9-81bb6fdf114c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:54.368980 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-c60f66a4-7c8b-4aca-85e9-81bb6fdf114c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:54.376480 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c60f66a4-7c8b-4aca-85e9-81bb6fdf114c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15" status: 200 len: 1515 microversion: 2.1 time: 0.151128 May 11 07:46:54.377043 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 392/781] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:54 2022] GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:55.395284 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9b43c1c6-f2c8-4cc8-b4ea-b0c8717783ee tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:55.395980 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9b43c1c6-f2c8-4cc8-b4ea-b0c8717783ee tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:55.402365 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9b43c1c6-f2c8-4cc8-b4ea-b0c8717783ee tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:55.402857 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9b43c1c6-f2c8-4cc8-b4ea-b0c8717783ee tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:55.403594 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9b43c1c6-f2c8-4cc8-b4ea-b0c8717783ee tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:55.404024 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9b43c1c6-f2c8-4cc8-b4ea-b0c8717783ee tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:55.536376 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9b43c1c6-f2c8-4cc8-b4ea-b0c8717783ee tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:55.544452 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9b43c1c6-f2c8-4cc8-b4ea-b0c8717783ee tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15" status: 200 len: 1515 microversion: 2.1 time: 0.153846 May 11 07:46:55.545009 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 390/782] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:55 2022] GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:56.561375 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-690dab37-02ab-4f43-b35a-5ddd0e19d0c6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:56.562015 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-690dab37-02ab-4f43-b35a-5ddd0e19d0c6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:56.568530 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-690dab37-02ab-4f43-b35a-5ddd0e19d0c6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:56.568999 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-690dab37-02ab-4f43-b35a-5ddd0e19d0c6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:56.569791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-690dab37-02ab-4f43-b35a-5ddd0e19d0c6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:56.570227 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-690dab37-02ab-4f43-b35a-5ddd0e19d0c6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:56.649223 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-690dab37-02ab-4f43-b35a-5ddd0e19d0c6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:46:56.656478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-690dab37-02ab-4f43-b35a-5ddd0e19d0c6 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15" status: 200 len: 1473 microversion: 2.1 time: 0.098966 May 11 07:46:56.657174 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 393/783] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:56 2022] GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15 => generated 1473 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:46:56.676767 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-1c22890e-db07-40f7-afe6-df7b77a13b6f req-f437be02-aff3-4817-b837-7e6ff2de313c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ed5625-305f-4088-b62a-1bd2e26f8b15", "name": "network-vif-deleted", "tag": "63b76a94-0623-4bf6-a405-6a029e1a42a8"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:46:56.685406 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-1c22890e-db07-40f7-afe6-df7b77a13b6f req-f437be02-aff3-4817-b837-7e6ff2de313c service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:56.685891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-1c22890e-db07-40f7-afe6-df7b77a13b6f req-f437be02-aff3-4817-b837-7e6ff2de313c service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:56.697076 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-1c22890e-db07-40f7-afe6-df7b77a13b6f req-f437be02-aff3-4817-b837-7e6ff2de313c service nova] Creating event network-vif-deleted:63b76a94-0623-4bf6-a405-6a029e1a42a8 for instance 00ed5625-305f-4088-b62a-1bd2e26f8b15 on hv-cinder-83699 May 11 07:46:56.701930 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-1c22890e-db07-40f7-afe6-df7b77a13b6f req-f437be02-aff3-4817-b837-7e6ff2de313c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029300 May 11 07:46:56.702625 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 391/784] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:46:57.674013 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-5b00e547-9886-4f8e-995a-fa0f51be9818 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:46:57.674547 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-5b00e547-9886-4f8e-995a-fa0f51be9818 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 00ed5625-305f-4088-b62a-1bd2e26f8b15] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:46:57.681236 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5b00e547-9886-4f8e-995a-fa0f51be9818 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:57.681717 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5b00e547-9886-4f8e-995a-fa0f51be9818 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:57.682469 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5b00e547-9886-4f8e-995a-fa0f51be9818 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:46:57.682898 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-5b00e547-9886-4f8e-995a-fa0f51be9818 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:46:57.696490 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-5b00e547-9886-4f8e-995a-fa0f51be9818 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] HTTP exception thrown: Instance 00ed5625-305f-4088-b62a-1bd2e26f8b15 could not be found. May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-5b00e547-9886-4f8e-995a-fa0f51be9818 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Request method failure captured: May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15 HTTP/1.1 May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2m5mlbIx7Q_dB5xmeNi51IT7PGGJUY1SK09J24u5eIsO6OPFpOYbQA7BJXfEL_jlB7Fx1KzlkH5jBW9nwtlY-mHBPpX70htut-eX2xhB61EPxQWe0vtKp5WZ4BGiE5M5y30qEW2RfnUxca8SrA-NmgkRKBKoeECkXhyLbw_RMGUKMM May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 0c4410fd6b2c46da89537b4923db6d89 May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-VolumesSnapshotTestJSON-350679859 May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:46:57.698107 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:46:57.699458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c4410fd6b2c46da89537b4923db6d89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c4410fd6b2c46da89537b4923db6d89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c4410fd6b2c46da89537b4923db6d89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c4410fd6b2c46da89537b4923db6d89"}]}] May 11 07:46:57.699458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-VolumesSnapshotTestJSON-350679859 May 11 07:46:57.699458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 0c4410fd6b2c46da89537b4923db6d89 May 11 07:46:57.699458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-350679859 May 11 07:46:57.699458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-VolumesSnapshotTestJSON-350679859-project May 11 07:46:57.699458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:46:57.699458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:46:57.699458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: e1b0351ac4564043b97f5499679cdc06 May 11 07:46:57.699458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-VolumesSnapshotTestJSON-350679859-project May 11 07:46:57.699458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:46:57.699458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance 00ed5625-305f-4088-b62a-1bd2e26f8b15 could not be found. May 11 07:46:57.699458 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '00ed5625-305f-4088-b62a-1bd2e26f8b15'} May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ed5625-305f-4088-b62a-1bd2e26f8b15 could not be found. May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:46:57.700452 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ed5625-305f-4088-b62a-1bd2e26f8b15 could not be found. May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ed5625-305f-4088-b62a-1bd2e26f8b15 could not be found. May 11 07:46:57.702008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:46:57.703350 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-5b00e547-9886-4f8e-995a-fa0f51be9818 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Returning 404 to user: Instance 00ed5625-305f-4088-b62a-1bd2e26f8b15 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:46:57.703350 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-5b00e547-9886-4f8e-995a-fa0f51be9818 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15" status: 404 len: 111 microversion: 2.1 time: 0.029347 May 11 07:46:57.703350 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 394/785] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:46:57 2022] GET /compute/v2.1/servers/00ed5625-305f-4088-b62a-1bd2e26f8b15 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:47:07.467481 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1089918217", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "networks": [{"uuid": "613e8e93-9a8d-41a7-94ab-6469f95f81a6"}]}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:07.516125 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.network.neutron [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] validate_networks() for [('613e8e93-9a8d-41a7-94ab-6469f95f81a6', None, None, None, None, None)] {{(pid=123600) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:47:07.855898 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Flavor limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:47:07.856318 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Image limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:47:07.856792 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Flavor pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:47:07.857201 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Image pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:47:07.857647 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:47:07.866744 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:07.867186 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:07.867991 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:07.868434 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:07.884210 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Getting quotas for project 0c4410fd6b2c46da89537b4923db6d89. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:47:07.888062 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Getting quotas for user e1b0351ac4564043b97f5499679cdc06 and project 0c4410fd6b2c46da89537b4923db6d89. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:47:07.898793 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Going to run 1 instances... {{(pid=123600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:47:07.901058 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:47:07.947342 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-78468432-5b9e-4e97-8529-9bee42867e2c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.484317 May 11 07:47:07.947905 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 392/786] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:47:07.962101 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ffe53ed7-023a-412c-a56c-efd258b7be5c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:07.963394 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ffe53ed7-023a-412c-a56c-efd258b7be5c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:08.019993 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ffe53ed7-023a-412c-a56c-efd258b7be5c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:08.026655 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ffe53ed7-023a-412c-a56c-efd258b7be5c tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3" status: 200 len: 1219 microversion: 2.1 time: 0.071926 May 11 07:47:08.027119 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 395/787] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:07 2022] GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:09.044548 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a5682ae3-892b-40ea-9eb9-5b817755a4eb tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:09.045164 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a5682ae3-892b-40ea-9eb9-5b817755a4eb tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:09.052523 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5682ae3-892b-40ea-9eb9-5b817755a4eb tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:09.052973 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5682ae3-892b-40ea-9eb9-5b817755a4eb tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:09.053778 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5682ae3-892b-40ea-9eb9-5b817755a4eb tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:09.054220 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a5682ae3-892b-40ea-9eb9-5b817755a4eb tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:09.118683 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a5682ae3-892b-40ea-9eb9-5b817755a4eb tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:09.126125 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a5682ae3-892b-40ea-9eb9-5b817755a4eb tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3" status: 200 len: 1277 microversion: 2.1 time: 0.085917 May 11 07:47:09.126696 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 393/788] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:09 2022] GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:10.145461 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-036fca58-a7be-44b5-9e76-ee31b4f54ef3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:10.146644 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-036fca58-a7be-44b5-9e76-ee31b4f54ef3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:10.153892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-036fca58-a7be-44b5-9e76-ee31b4f54ef3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:10.154344 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-036fca58-a7be-44b5-9e76-ee31b4f54ef3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:10.155125 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-036fca58-a7be-44b5-9e76-ee31b4f54ef3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:10.155561 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-036fca58-a7be-44b5-9e76-ee31b4f54ef3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:10.193950 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-2233b9a7-9aa4-46b6-aa41-ee2b9721ab6a req-c5e8084b-7362-4b64-a474-ab91bf46cbc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "888d3d7a-ba5f-448d-ac81-3bdaba0dacb3", "tag": "0d6698f3-fb47-43e1-8466-1d905f7f9c2c"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:10.202740 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-2233b9a7-9aa4-46b6-aa41-ee2b9721ab6a req-c5e8084b-7362-4b64-a474-ab91bf46cbc0 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:10.212276 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-2233b9a7-9aa4-46b6-aa41-ee2b9721ab6a req-c5e8084b-7362-4b64-a474-ab91bf46cbc0 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:10.225820 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-2233b9a7-9aa4-46b6-aa41-ee2b9721ab6a req-c5e8084b-7362-4b64-a474-ab91bf46cbc0 service nova] Creating event network-changed:0d6698f3-fb47-43e1-8466-1d905f7f9c2c for instance 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 on hv-cinder-83699 May 11 07:47:10.230695 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-2233b9a7-9aa4-46b6-aa41-ee2b9721ab6a req-c5e8084b-7362-4b64-a474-ab91bf46cbc0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047782 May 11 07:47:10.231548 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 394/789] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:10.392780 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-036fca58-a7be-44b5-9e76-ee31b4f54ef3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:10.400188 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-036fca58-a7be-44b5-9e76-ee31b4f54ef3 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3" status: 200 len: 1319 microversion: 2.1 time: 0.259618 May 11 07:47:10.400831 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 396/790] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:10 2022] GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:11.417993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8dbfb6af-bc4a-415a-a429-e0cdf121c4b2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:11.418684 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8dbfb6af-bc4a-415a-a429-e0cdf121c4b2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:11.424772 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8dbfb6af-bc4a-415a-a429-e0cdf121c4b2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:11.425223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8dbfb6af-bc4a-415a-a429-e0cdf121c4b2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:11.426016 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8dbfb6af-bc4a-415a-a429-e0cdf121c4b2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:11.426481 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8dbfb6af-bc4a-415a-a429-e0cdf121c4b2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:11.555625 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8dbfb6af-bc4a-415a-a429-e0cdf121c4b2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:11.562866 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8dbfb6af-bc4a-415a-a429-e0cdf121c4b2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3" status: 200 len: 1319 microversion: 2.1 time: 0.149534 May 11 07:47:11.563418 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 395/791] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:11 2022] GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:12.580380 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-4de45f91-638c-404e-9fde-60effe17cdf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:12.580994 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-4de45f91-638c-404e-9fde-60effe17cdf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:12.587934 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4de45f91-638c-404e-9fde-60effe17cdf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:12.588385 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4de45f91-638c-404e-9fde-60effe17cdf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:12.589152 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4de45f91-638c-404e-9fde-60effe17cdf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:12.589617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-4de45f91-638c-404e-9fde-60effe17cdf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:12.713350 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-4de45f91-638c-404e-9fde-60effe17cdf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:12.720474 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-4de45f91-638c-404e-9fde-60effe17cdf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3" status: 200 len: 1319 microversion: 2.1 time: 0.144194 May 11 07:47:12.721037 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 397/792] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:12 2022] GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:13.738431 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ac7e214b-6d6a-4f7a-9f5b-3298b2a27f71 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:13.739026 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-ac7e214b-6d6a-4f7a-9f5b-3298b2a27f71 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:13.745306 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ac7e214b-6d6a-4f7a-9f5b-3298b2a27f71 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:13.745797 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ac7e214b-6d6a-4f7a-9f5b-3298b2a27f71 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:13.746562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ac7e214b-6d6a-4f7a-9f5b-3298b2a27f71 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:13.747009 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ac7e214b-6d6a-4f7a-9f5b-3298b2a27f71 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:13.873181 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-ac7e214b-6d6a-4f7a-9f5b-3298b2a27f71 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:13.880365 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-ac7e214b-6d6a-4f7a-9f5b-3298b2a27f71 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3" status: 200 len: 1319 microversion: 2.1 time: 0.146329 May 11 07:47:13.880926 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 396/793] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:13 2022] GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:14.898430 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7ee01a7f-5c9c-4cb3-9937-81af3f019379 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:14.899424 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-7ee01a7f-5c9c-4cb3-9937-81af3f019379 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:14.905496 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7ee01a7f-5c9c-4cb3-9937-81af3f019379 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:14.905971 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7ee01a7f-5c9c-4cb3-9937-81af3f019379 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:14.906738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7ee01a7f-5c9c-4cb3-9937-81af3f019379 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:14.907172 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7ee01a7f-5c9c-4cb3-9937-81af3f019379 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:15.034589 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-7ee01a7f-5c9c-4cb3-9937-81af3f019379 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:15.041774 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-7ee01a7f-5c9c-4cb3-9937-81af3f019379 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3" status: 200 len: 1319 microversion: 2.1 time: 0.148014 May 11 07:47:15.042347 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 398/794] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:14 2022] GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:15.070199 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-2fc5686d-5d2d-492a-ac54-4819a77780b1 req-4946e602-4b0c-422e-bd26-5bafbec6daff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "888d3d7a-ba5f-448d-ac81-3bdaba0dacb3", "name": "network-vif-plugged", "status": "completed", "tag": "0d6698f3-fb47-43e1-8466-1d905f7f9c2c"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:15.079030 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-2fc5686d-5d2d-492a-ac54-4819a77780b1 req-4946e602-4b0c-422e-bd26-5bafbec6daff service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:15.079479 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-2fc5686d-5d2d-492a-ac54-4819a77780b1 req-4946e602-4b0c-422e-bd26-5bafbec6daff service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:15.090799 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-2fc5686d-5d2d-492a-ac54-4819a77780b1 req-4946e602-4b0c-422e-bd26-5bafbec6daff service nova] Creating event network-vif-plugged:0d6698f3-fb47-43e1-8466-1d905f7f9c2c for instance 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 on hv-cinder-83699 May 11 07:47:15.095646 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-2fc5686d-5d2d-492a-ac54-4819a77780b1 req-4946e602-4b0c-422e-bd26-5bafbec6daff service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030046 May 11 07:47:15.096250 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 397/795] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:16.060694 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-68f05747-4b6d-4fa4-915d-34a474e2290b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:16.061294 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-68f05747-4b6d-4fa4-915d-34a474e2290b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:16.068036 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-68f05747-4b6d-4fa4-915d-34a474e2290b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:16.068483 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-68f05747-4b6d-4fa4-915d-34a474e2290b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:16.069237 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-68f05747-4b6d-4fa4-915d-34a474e2290b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:16.069703 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-68f05747-4b6d-4fa4-915d-34a474e2290b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:16.194261 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-68f05747-4b6d-4fa4-915d-34a474e2290b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:16.201469 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-68f05747-4b6d-4fa4-915d-34a474e2290b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3" status: 200 len: 1319 microversion: 2.1 time: 0.145418 May 11 07:47:16.202056 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 399/796] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:16 2022] GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:17.219356 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-20b308e8-1fde-43a2-a93b-1876c3ba15de tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:17.220061 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-20b308e8-1fde-43a2-a93b-1876c3ba15de tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:17.226596 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-20b308e8-1fde-43a2-a93b-1876c3ba15de tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:17.227047 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-20b308e8-1fde-43a2-a93b-1876c3ba15de tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:17.227829 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-20b308e8-1fde-43a2-a93b-1876c3ba15de tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:17.228266 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-20b308e8-1fde-43a2-a93b-1876c3ba15de tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:17.353296 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-20b308e8-1fde-43a2-a93b-1876c3ba15de tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:17.360466 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-20b308e8-1fde-43a2-a93b-1876c3ba15de tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3" status: 200 len: 1509 microversion: 2.1 time: 0.146199 May 11 07:47:17.361019 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 398/797] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:17 2022] GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:17.377143 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-54785a5c-9362-4e15-8dec-1c6520061233 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0aaa4c05-b2fa-4ef1-8687-a87bcc4903f3", "device": "/dev/sdb"}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:17.378377 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-54785a5c-9362-4e15-8dec-1c6520061233 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:17.384619 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-54785a5c-9362-4e15-8dec-1c6520061233 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:17.385069 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-54785a5c-9362-4e15-8dec-1c6520061233 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:17.385854 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-54785a5c-9362-4e15-8dec-1c6520061233 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:17.386287 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-54785a5c-9362-4e15-8dec-1c6520061233 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:17.645323 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-54785a5c-9362-4e15-8dec-1c6520061233 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "POST /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271814 May 11 07:47:17.646250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 400/798] 10.222.0.36 () {60 vars in 1322 bytes} [Wed May 11 07:47:17 2022] POST /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:21.010370 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1220e577-56e6-43c4-a215-3de88538ed53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:21.010888 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-1220e577-56e6-43c4-a215-3de88538ed53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:21.017126 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1220e577-56e6-43c4-a215-3de88538ed53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:21.017611 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1220e577-56e6-43c4-a215-3de88538ed53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:21.018374 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1220e577-56e6-43c4-a215-3de88538ed53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:21.018812 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1220e577-56e6-43c4-a215-3de88538ed53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:21.040461 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-1220e577-56e6-43c4-a215-3de88538ed53 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0/ips" status: 200 len: 148 microversion: 2.1 time: 0.034007 May 11 07:47:21.041014 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 399/799] 10.222.0.36 () {58 vars in 1247 bytes} [Wed May 11 07:47:21 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0/ips => generated 148 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:21.053418 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2a997b3d-0470-47d5-9397-82daef7216af tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a46f544-6bca-4f43-96b3-1415284986c5"}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:21.054635 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2a997b3d-0470-47d5-9397-82daef7216af tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:21.060679 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2a997b3d-0470-47d5-9397-82daef7216af tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:21.061146 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2a997b3d-0470-47d5-9397-82daef7216af tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:21.061929 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2a997b3d-0470-47d5-9397-82daef7216af tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:21.062389 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2a997b3d-0470-47d5-9397-82daef7216af tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:21.137314 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-2a997b3d-0470-47d5-9397-82daef7216af tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] HTTP exception thrown: Invalid volume: volume 3a46f544-6bca-4f43-96b3-1415284986c5 is already attached to instances: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2a997b3d-0470-47d5-9397-82daef7216af tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Request method failure captured: May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: POST /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0/os-volume_attachments HTTP/1.1 May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 74 May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2mEHqQL-u3ouRY26Qw00htshbb-Yff6Ho3PvS4ty6HQr0GnvWuxtj6K5fRiT6sYE4t3AbTSvAlw3oMBLjIhYarCsmhj2jk7lLeHkyPOY-QXvOFSOdAVZ-fXXXrmiCClFSyTB3XsO_5HsLGbCQ8V4LKdnzODb28mc4LszNG8l56As9U May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:47:21.139117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:47:21.140755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbefc9c91dab46baa2707f01c83e48e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}] May 11 07:47:21.140755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:47:21.140755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:47:21.140755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:47:21.140755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:47:21.140755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:47:21.140755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:47:21.140755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: cb737cfd514343dfbfbc30816cf5f655 May 11 07:47:21.140755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:47:21.140755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: May 11 07:47:21.140755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {"volumeAttachment": {"volumeId": "3a46f544-6bca-4f43-96b3-1415284986c5"}} May 11 07:47:21.140755 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Invalid volume: volume 3a46f544-6bca-4f43-96b3-1415284986c5 is already attached to instances: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'server_id': 'eb54010c-43ca-4040-8312-da1d47697fa0', 'body': {'volumeAttachment': {'volumeId': '3a46f544-6bca-4f43-96b3-1415284986c5'}}} May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3a46f544-6bca-4f43-96b3-1415284986c5 is already attached to instances: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:47:21.141943 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3a46f544-6bca-4f43-96b3-1415284986c5 is already attached to instances: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:21.143491 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:47:21.145006 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:47:21.145006 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:47:21.145006 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:47:21.145006 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3a46f544-6bca-4f43-96b3-1415284986c5 is already attached to instances: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 May 11 07:47:21.145006 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:47:21.145006 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2a997b3d-0470-47d5-9397-82daef7216af tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Returning 400 to user: Invalid volume: volume 3a46f544-6bca-4f43-96b3-1415284986c5 is already attached to instances: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:47:21.145006 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2a997b3d-0470-47d5-9397-82daef7216af tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "POST /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092349 May 11 07:47:21.145006 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 401/800] 10.222.0.36 () {60 vars in 1322 bytes} [Wed May 11 07:47:21 2022] POST /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 07:47:21.149111 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e93b8edf-c809-4aac-888c-9b774137d809 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:21.149646 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e93b8edf-c809-4aac-888c-9b774137d809 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:21.155431 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e93b8edf-c809-4aac-888c-9b774137d809 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:21.155882 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e93b8edf-c809-4aac-888c-9b774137d809 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:21.156644 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e93b8edf-c809-4aac-888c-9b774137d809 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:21.157084 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e93b8edf-c809-4aac-888c-9b774137d809 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:21.181632 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e93b8edf-c809-4aac-888c-9b774137d809 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Going to try to terminate instance {{(pid=123600) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:47:21.253512 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e93b8edf-c809-4aac-888c-9b774137d809 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 204 len: 0 microversion: 2.1 time: 0.107692 May 11 07:47:21.254372 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 400/801] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:47:21 2022] DELETE /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:47:21.263913 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-cf797188-b4e7-408a-ad7c-6ae15457d605 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:21.264521 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-cf797188-b4e7-408a-ad7c-6ae15457d605 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:21.272132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cf797188-b4e7-408a-ad7c-6ae15457d605 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:21.272650 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cf797188-b4e7-408a-ad7c-6ae15457d605 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:21.273474 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cf797188-b4e7-408a-ad7c-6ae15457d605 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:21.273953 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-cf797188-b4e7-408a-ad7c-6ae15457d605 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:21.402079 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-cf797188-b4e7-408a-ad7c-6ae15457d605 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:21.409290 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-cf797188-b4e7-408a-ad7c-6ae15457d605 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 200 len: 1680 microversion: 2.1 time: 0.150448 May 11 07:47:21.409875 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 402/802] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:21 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:22.426187 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b66744ee-84fb-44dc-8f12-c96bedf53759 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:22.426881 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-b66744ee-84fb-44dc-8f12-c96bedf53759 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:22.433126 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b66744ee-84fb-44dc-8f12-c96bedf53759 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:22.433601 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b66744ee-84fb-44dc-8f12-c96bedf53759 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:22.434369 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b66744ee-84fb-44dc-8f12-c96bedf53759 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:22.434807 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b66744ee-84fb-44dc-8f12-c96bedf53759 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:22.563630 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-b66744ee-84fb-44dc-8f12-c96bedf53759 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:22.571093 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-b66744ee-84fb-44dc-8f12-c96bedf53759 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 200 len: 1680 microversion: 2.1 time: 0.149138 May 11 07:47:22.571651 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 401/803] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:22 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:23.587994 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-030d01a6-3d97-4dff-b135-c39956335f2f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:23.588598 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-030d01a6-3d97-4dff-b135-c39956335f2f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:23.594978 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-030d01a6-3d97-4dff-b135-c39956335f2f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:23.595427 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-030d01a6-3d97-4dff-b135-c39956335f2f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:23.596202 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-030d01a6-3d97-4dff-b135-c39956335f2f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:23.597137 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-030d01a6-3d97-4dff-b135-c39956335f2f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:23.843937 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-030d01a6-3d97-4dff-b135-c39956335f2f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:23.851934 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-030d01a6-3d97-4dff-b135-c39956335f2f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 200 len: 1680 microversion: 2.1 time: 0.267837 May 11 07:47:23.852505 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 403/804] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:23 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 1680 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:24.083691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-f56dfd67-87ed-4c68-9a56-f699d2638088 req-39edff0e-be42-435d-a3e1-3f03c1c1cc5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb54010c-43ca-4040-8312-da1d47697fa0", "name": "network-vif-deleted", "tag": "7650d3c7-12fe-44ab-bafa-6392cb592348"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:24.091802 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-f56dfd67-87ed-4c68-9a56-f699d2638088 req-39edff0e-be42-435d-a3e1-3f03c1c1cc5e service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:24.092251 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-f56dfd67-87ed-4c68-9a56-f699d2638088 req-39edff0e-be42-435d-a3e1-3f03c1c1cc5e service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:24.284266 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-f56dfd67-87ed-4c68-9a56-f699d2638088 req-39edff0e-be42-435d-a3e1-3f03c1c1cc5e service nova] Creating event network-vif-deleted:7650d3c7-12fe-44ab-bafa-6392cb592348 for instance eb54010c-43ca-4040-8312-da1d47697fa0 on hv-cinder-83699 May 11 07:47:24.289188 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-f56dfd67-87ed-4c68-9a56-f699d2638088 req-39edff0e-be42-435d-a3e1-3f03c1c1cc5e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208985 May 11 07:47:24.289827 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 402/805] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:24.868776 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-741a74ee-af4a-4c52-bd3d-ffbaa5e62898 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:24.869391 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-741a74ee-af4a-4c52-bd3d-ffbaa5e62898 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:24.876009 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-741a74ee-af4a-4c52-bd3d-ffbaa5e62898 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:24.876457 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-741a74ee-af4a-4c52-bd3d-ffbaa5e62898 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:24.877230 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-741a74ee-af4a-4c52-bd3d-ffbaa5e62898 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:24.877737 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-741a74ee-af4a-4c52-bd3d-ffbaa5e62898 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:24.891485 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-741a74ee-af4a-4c52-bd3d-ffbaa5e62898 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] HTTP exception thrown: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-741a74ee-af4a-4c52-bd3d-ffbaa5e62898 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Request method failure captured: May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 HTTP/1.1 May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2mEHqQL-u3ouRY26Qw00htshbb-Yff6Ho3PvS4ty6HQr0GnvWuxtj6K5fRiT6sYE4t3AbTSvAlw3oMBLjIhYarCsmhj2jk7lLeHkyPOY-QXvOFSOdAVZ-fXXXrmiCClFSyTB3XsO_5HsLGbCQ8V4LKdnzODb28mc4LszNG8l56As9U May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:47:24.893042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:47:24.894617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbefc9c91dab46baa2707f01c83e48e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}] May 11 07:47:24.894617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:47:24.894617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:47:24.894617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:47:24.894617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:47:24.894617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:47:24.894617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:47:24.894617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: cb737cfd514343dfbfbc30816cf5f655 May 11 07:47:24.894617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:47:24.894617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:47:24.894617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:47:24.894617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': 'eb54010c-43ca-4040-8312-da1d47697fa0'} May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:47:24.895431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:47:24.896838 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:47:24.898170 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-741a74ee-af4a-4c52-bd3d-ffbaa5e62898 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Returning 404 to user: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:47:24.898170 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-741a74ee-af4a-4c52-bd3d-ffbaa5e62898 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 404 len: 111 microversion: 2.1 time: 0.029576 May 11 07:47:24.898170 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 404/806] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:24 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:47:24.903770 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1d8b2b54-5042-4891-8779-5f9a513021de tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '.version_select at 0x7f19ec70eca0>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:24.921862 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-1d8b2b54-5042-4891-8779-5f9a513021de tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822374800" status: 202 len: 0 microversion: 2.1 time: 0.022096 May 11 07:47:24.922529 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 403/807] 10.222.0.36 () {58 vars in 1220 bytes} [Wed May 11 07:47:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822374800 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:47:25.607852 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a22ec6fa-34a2-4e2c-b394-72de4d9b34bd tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:25.608350 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a22ec6fa-34a2-4e2c-b394-72de4d9b34bd tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:25.614215 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a22ec6fa-34a2-4e2c-b394-72de4d9b34bd tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:25.614666 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a22ec6fa-34a2-4e2c-b394-72de4d9b34bd tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:25.615423 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a22ec6fa-34a2-4e2c-b394-72de4d9b34bd tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:25.615858 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a22ec6fa-34a2-4e2c-b394-72de4d9b34bd tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:25.692079 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.objects.instance [None req-a22ec6fa-34a2-4e2c-b394-72de4d9b34bd tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lazy-loading 'services' on Instance uuid 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 {{(pid=123599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:47:25.761830 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a22ec6fa-34a2-4e2c-b394-72de4d9b34bd tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-volume_attachments/3a46f544-6bca-4f43-96b3-1415284986c5" status: 202 len: 0 microversion: 2.1 time: 0.157567 May 11 07:47:25.762466 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 405/808] 10.222.0.36 () {58 vars in 1415 bytes} [Wed May 11 07:47:25 2022] DELETE /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-volume_attachments/3a46f544-6bca-4f43-96b3-1415284986c5 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:47:25.772268 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4379f0f5-47ba-410a-9dcc-bbcb82d851c7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:25.773887 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4379f0f5-47ba-410a-9dcc-bbcb82d851c7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:25.781531 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4379f0f5-47ba-410a-9dcc-bbcb82d851c7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:25.782023 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4379f0f5-47ba-410a-9dcc-bbcb82d851c7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:25.783334 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4379f0f5-47ba-410a-9dcc-bbcb82d851c7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:25.783334 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4379f0f5-47ba-410a-9dcc-bbcb82d851c7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:25.811176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4379f0f5-47ba-410a-9dcc-bbcb82d851c7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044476 May 11 07:47:25.811720 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 404/809] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:47:25 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:26.824095 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-54966674-12fa-4ba7-8dd1-5302e1bca724 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:26.825078 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-54966674-12fa-4ba7-8dd1-5302e1bca724 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:26.831698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-54966674-12fa-4ba7-8dd1-5302e1bca724 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:26.832147 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-54966674-12fa-4ba7-8dd1-5302e1bca724 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:26.832920 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-54966674-12fa-4ba7-8dd1-5302e1bca724 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:26.833360 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-54966674-12fa-4ba7-8dd1-5302e1bca724 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:26.861725 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-54966674-12fa-4ba7-8dd1-5302e1bca724 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042601 May 11 07:47:26.862257 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 406/810] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:47:26 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:27.873207 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-6a2da1ea-146d-4d30-b0b2-9e3771f766c6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:27.874154 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-6a2da1ea-146d-4d30-b0b2-9e3771f766c6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:27.880873 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6a2da1ea-146d-4d30-b0b2-9e3771f766c6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:27.881325 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6a2da1ea-146d-4d30-b0b2-9e3771f766c6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:27.882119 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6a2da1ea-146d-4d30-b0b2-9e3771f766c6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:27.882555 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-6a2da1ea-146d-4d30-b0b2-9e3771f766c6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:27.911011 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-6a2da1ea-146d-4d30-b0b2-9e3771f766c6 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041799 May 11 07:47:27.911542 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 405/811] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:47:27 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:28.922138 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7f3b6599-a092-43d3-ab53-fc5360c18d0b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:28.923052 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-7f3b6599-a092-43d3-ab53-fc5360c18d0b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:28.929563 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7f3b6599-a092-43d3-ab53-fc5360c18d0b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:28.930018 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7f3b6599-a092-43d3-ab53-fc5360c18d0b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:28.930780 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7f3b6599-a092-43d3-ab53-fc5360c18d0b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:28.931219 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7f3b6599-a092-43d3-ab53-fc5360c18d0b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:28.959745 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-7f3b6599-a092-43d3-ab53-fc5360c18d0b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041486 May 11 07:47:28.960298 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 407/812] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:47:28 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:29.971183 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4d9e198b-3fde-419d-bded-6b67a70a1cc2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:29.972733 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4d9e198b-3fde-419d-bded-6b67a70a1cc2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:29.979109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4d9e198b-3fde-419d-bded-6b67a70a1cc2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:29.979548 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4d9e198b-3fde-419d-bded-6b67a70a1cc2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:29.980315 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4d9e198b-3fde-419d-bded-6b67a70a1cc2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:29.980801 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4d9e198b-3fde-419d-bded-6b67a70a1cc2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:30.007964 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4d9e198b-3fde-419d-bded-6b67a70a1cc2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040688 May 11 07:47:30.008498 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 406/813] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:47:29 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 07:47:30.064115 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-dc4b02ef-00a1-4e54-9df3-d75153b9d4b9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:30.064621 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-dc4b02ef-00a1-4e54-9df3-d75153b9d4b9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:30.071119 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dc4b02ef-00a1-4e54-9df3-d75153b9d4b9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:30.071565 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dc4b02ef-00a1-4e54-9df3-d75153b9d4b9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:30.072323 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dc4b02ef-00a1-4e54-9df3-d75153b9d4b9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:30.072759 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-dc4b02ef-00a1-4e54-9df3-d75153b9d4b9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:30.097668 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-dc4b02ef-00a1-4e54-9df3-d75153b9d4b9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Going to try to terminate instance {{(pid=123599) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:47:30.167659 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-dc4b02ef-00a1-4e54-9df3-d75153b9d4b9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 204 len: 0 microversion: 2.1 time: 0.107120 May 11 07:47:30.168221 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 408/814] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:47:30 2022] DELETE /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 07:47:30.176267 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-901fab80-c19a-4ae5-b7ad-16fdf4ffa52f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:30.176874 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-901fab80-c19a-4ae5-b7ad-16fdf4ffa52f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:30.182735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-901fab80-c19a-4ae5-b7ad-16fdf4ffa52f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:30.183188 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-901fab80-c19a-4ae5-b7ad-16fdf4ffa52f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:30.183952 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-901fab80-c19a-4ae5-b7ad-16fdf4ffa52f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:30.184392 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-901fab80-c19a-4ae5-b7ad-16fdf4ffa52f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:30.318000 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-901fab80-c19a-4ae5-b7ad-16fdf4ffa52f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:30.325178 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-901fab80-c19a-4ae5-b7ad-16fdf4ffa52f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1679 microversion: 2.1 time: 0.152747 May 11 07:47:30.325753 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 407/815] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:30 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:31.343158 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-eb4504c8-5ff8-4fab-a064-bdaab228c2d7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:31.343852 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-eb4504c8-5ff8-4fab-a064-bdaab228c2d7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:31.350632 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-eb4504c8-5ff8-4fab-a064-bdaab228c2d7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:31.351077 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-eb4504c8-5ff8-4fab-a064-bdaab228c2d7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:31.351835 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-eb4504c8-5ff8-4fab-a064-bdaab228c2d7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:31.352265 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-eb4504c8-5ff8-4fab-a064-bdaab228c2d7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:31.477765 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-eb4504c8-5ff8-4fab-a064-bdaab228c2d7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:31.485291 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-eb4504c8-5ff8-4fab-a064-bdaab228c2d7 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1679 microversion: 2.1 time: 0.146124 May 11 07:47:31.485672 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 409/816] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:31 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:32.502004 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2ede02f6-9e56-4949-9837-c21e3a9933c3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:32.502616 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2ede02f6-9e56-4949-9837-c21e3a9933c3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:32.508984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2ede02f6-9e56-4949-9837-c21e3a9933c3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:32.509437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2ede02f6-9e56-4949-9837-c21e3a9933c3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:32.510229 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2ede02f6-9e56-4949-9837-c21e3a9933c3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:32.510666 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2ede02f6-9e56-4949-9837-c21e3a9933c3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:32.638293 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-2ede02f6-9e56-4949-9837-c21e3a9933c3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:32.647314 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2ede02f6-9e56-4949-9837-c21e3a9933c3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1679 microversion: 2.1 time: 0.148717 May 11 07:47:32.648511 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 408/817] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:32 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:33.666970 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d8aefa4f-a92a-41ad-b58f-000f5044650d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:33.667683 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d8aefa4f-a92a-41ad-b58f-000f5044650d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:33.674105 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d8aefa4f-a92a-41ad-b58f-000f5044650d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:33.675048 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d8aefa4f-a92a-41ad-b58f-000f5044650d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:33.675802 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d8aefa4f-a92a-41ad-b58f-000f5044650d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:33.676230 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d8aefa4f-a92a-41ad-b58f-000f5044650d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:33.811916 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d8aefa4f-a92a-41ad-b58f-000f5044650d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:33.820273 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d8aefa4f-a92a-41ad-b58f-000f5044650d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1679 microversion: 2.1 time: 0.157151 May 11 07:47:33.820835 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 410/818] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:33 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:34.837248 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-afe7c3bb-5491-43b8-bd4e-828d4de6749a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:34.837887 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-afe7c3bb-5491-43b8-bd4e-828d4de6749a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:34.844101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-afe7c3bb-5491-43b8-bd4e-828d4de6749a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:34.844558 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-afe7c3bb-5491-43b8-bd4e-828d4de6749a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:34.845318 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-afe7c3bb-5491-43b8-bd4e-828d4de6749a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:34.845775 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-afe7c3bb-5491-43b8-bd4e-828d4de6749a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:34.914627 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-afe7c3bb-5491-43b8-bd4e-828d4de6749a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:34.922210 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-afe7c3bb-5491-43b8-bd4e-828d4de6749a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1611 microversion: 2.1 time: 0.088817 May 11 07:47:34.922783 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 409/819] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:34 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1611 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:35.177472 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-e5383a6b-2eeb-413d-b57a-3606e2a9e7fc req-98edb8c4-22a2-4f77-b048-d8a8266d3c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c09ecce-a2f8-499a-81fc-b35151fdd6b4", "name": "network-vif-deleted", "tag": "548f0c13-5720-409d-934a-ad902e0200b1"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:35.185790 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-e5383a6b-2eeb-413d-b57a-3606e2a9e7fc req-98edb8c4-22a2-4f77-b048-d8a8266d3c0b service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:35.186235 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-e5383a6b-2eeb-413d-b57a-3606e2a9e7fc req-98edb8c4-22a2-4f77-b048-d8a8266d3c0b service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:35.197335 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-e5383a6b-2eeb-413d-b57a-3606e2a9e7fc req-98edb8c4-22a2-4f77-b048-d8a8266d3c0b service nova] Creating event network-vif-deleted:548f0c13-5720-409d-934a-ad902e0200b1 for instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 on hv-cinder-83699 May 11 07:47:35.202328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-e5383a6b-2eeb-413d-b57a-3606e2a9e7fc req-98edb8c4-22a2-4f77-b048-d8a8266d3c0b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028999 May 11 07:47:35.202924 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 411/820] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:35.939412 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-739b2db2-227e-441a-bf06-7d677b2ac0c2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:35.940597 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-739b2db2-227e-441a-bf06-7d677b2ac0c2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:35.947012 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-739b2db2-227e-441a-bf06-7d677b2ac0c2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:35.947465 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-739b2db2-227e-441a-bf06-7d677b2ac0c2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:35.948240 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-739b2db2-227e-441a-bf06-7d677b2ac0c2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:35.948674 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-739b2db2-227e-441a-bf06-7d677b2ac0c2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:35.980342 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-739b2db2-227e-441a-bf06-7d677b2ac0c2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:35.980802 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-739b2db2-227e-441a-bf06-7d677b2ac0c2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:35.981293 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.objects.instance [None req-739b2db2-227e-441a-bf06-7d677b2ac0c2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lazy-loading 'fault' on Instance uuid 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 {{(pid=123600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:47:36.028010 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-739b2db2-227e-441a-bf06-7d677b2ac0c2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:36.036709 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-739b2db2-227e-441a-bf06-7d677b2ac0c2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 200 len: 1329 microversion: 2.1 time: 0.101152 May 11 07:47:36.037288 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 410/821] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:35 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 1329 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:36.945625 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2c69b97b-ee3e-4d6a-9e8f-9ae495a5f538 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:36.946195 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2c69b97b-ee3e-4d6a-9e8f-9ae495a5f538 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:36.952516 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c69b97b-ee3e-4d6a-9e8f-9ae495a5f538 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:36.952958 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c69b97b-ee3e-4d6a-9e8f-9ae495a5f538 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:36.953968 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c69b97b-ee3e-4d6a-9e8f-9ae495a5f538 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:36.954400 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c69b97b-ee3e-4d6a-9e8f-9ae495a5f538 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:37.032157 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.objects.instance [None req-2c69b97b-ee3e-4d6a-9e8f-9ae495a5f538 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lazy-loading 'services' on Instance uuid 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 {{(pid=123599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:47:37.054954 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-168d21ca-7581-4b5b-8849-fc9c3280e2fa tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:37.055556 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-168d21ca-7581-4b5b-8849-fc9c3280e2fa tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:37.061970 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-168d21ca-7581-4b5b-8849-fc9c3280e2fa tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:37.062423 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-168d21ca-7581-4b5b-8849-fc9c3280e2fa tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:37.063192 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-168d21ca-7581-4b5b-8849-fc9c3280e2fa tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:37.063623 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-168d21ca-7581-4b5b-8849-fc9c3280e2fa tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:37.076790 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-168d21ca-7581-4b5b-8849-fc9c3280e2fa tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] HTTP exception thrown: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-168d21ca-7581-4b5b-8849-fc9c3280e2fa tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Request method failure captured: May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 HTTP/1.1 May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2mEHqQL-u3ouRY26Qw00htshbb-Yff6Ho3PvS4ty6HQr0GnvWuxtj6K5fRiT6sYE4t3AbTSvAlw3oMBLjIhYarCsmhj2jk7lLeHkyPOY-QXvOFSOdAVZ-fXXXrmiCClFSyTB3XsO_5HsLGbCQ8V4LKdnzODb28mc4LszNG8l56As9U May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:47:37.078429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:47:37.079968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbefc9c91dab46baa2707f01c83e48e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}] May 11 07:47:37.079968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:47:37.079968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:47:37.079968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:47:37.079968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:47:37.079968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:47:37.079968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:47:37.079968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: cb737cfd514343dfbfbc30816cf5f655 May 11 07:47:37.079968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:47:37.079968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:47:37.079968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:47:37.079968 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '2c09ecce-a2f8-499a-81fc-b35151fdd6b4'} May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:47:37.080813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:47:37.082101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:37.083312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-168d21ca-7581-4b5b-8849-fc9c3280e2fa tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Returning 404 to user: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:47:37.083312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-168d21ca-7581-4b5b-8849-fc9c3280e2fa tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 404 len: 111 microversion: 2.1 time: 0.028720 May 11 07:47:37.083312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 411/822] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:37 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 07:47:37.088891 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-dd29b857-a334-41e9-b029-60b3d84db66c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '.version_select at 0x7f19ec9a91f0>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:37.105171 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2c69b97b-ee3e-4d6a-9e8f-9ae495a5f538 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "DELETE /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3/os-volume_attachments/0aaa4c05-b2fa-4ef1-8687-a87bcc4903f3" status: 202 len: 0 microversion: 2.1 time: 0.164225 May 11 07:47:37.105824 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 412/823] 10.222.0.36 () {58 vars in 1415 bytes} [Wed May 11 07:47:36 2022] DELETE /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3/os-volume_attachments/0aaa4c05-b2fa-4ef1-8687-a87bcc4903f3 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:47:37.110846 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-dd29b857-a334-41e9-b029-60b3d84db66c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-783081354" status: 202 len: 0 microversion: 2.1 time: 0.026118 May 11 07:47:37.111563 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 412/824] 10.222.0.36 () {58 vars in 1217 bytes} [Wed May 11 07:47:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-783081354 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 07:47:37.724930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c4ab9aa7-ad7e-4923-805e-dc2973241083 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Action: 'create', calling method: .version_select at 0x7f19ec889a60>, body: {"keypair": {"name": "tempest-keypair-646184569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmmo4dX0V1kYPREE+FaMJiY1eM+DTt6rSByIX2NFQkwHUL5MToFLr0s7qjseFbsZeNpgxlUfhrAOIfwnLjLRaDw8gPMLq7XnE76Ebu+HlSGMwnER5Cz49Sj8F6Md5NKKw=="}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:37.738373 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-c4ab9aa7-ad7e-4923-805e-dc2973241083 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:47:37.742042 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-c4ab9aa7-ad7e-4923-805e-dc2973241083 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for user cb737cfd514343dfbfbc30816cf5f655 and project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:47:37.764849 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c4ab9aa7-ad7e-4923-805e-dc2973241083 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044138 May 11 07:47:37.765647 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 413/825] 10.222.0.36 () {60 vars in 1158 bytes} [Wed May 11 07:47:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:38.218517 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-011f10fe-e186-4de7-9330-1f3e2c33b2f2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:38.219076 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-011f10fe-e186-4de7-9330-1f3e2c33b2f2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:38.226123 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-011f10fe-e186-4de7-9330-1f3e2c33b2f2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:38.226569 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-011f10fe-e186-4de7-9330-1f3e2c33b2f2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:38.227334 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-011f10fe-e186-4de7-9330-1f3e2c33b2f2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:38.227773 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-011f10fe-e186-4de7-9330-1f3e2c33b2f2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:38.251999 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-011f10fe-e186-4de7-9330-1f3e2c33b2f2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Going to try to terminate instance {{(pid=123600) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:47:38.328700 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-011f10fe-e186-4de7-9330-1f3e2c33b2f2 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "DELETE /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3" status: 204 len: 0 microversion: 2.1 time: 0.113741 May 11 07:47:38.329457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 413/826] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:47:38 2022] DELETE /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 07:47:38.338134 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-551e8a85-a6b0-43ba-85da-645122f45bf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:38.338891 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-551e8a85-a6b0-43ba-85da-645122f45bf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:38.344964 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-551e8a85-a6b0-43ba-85da-645122f45bf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:38.345413 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-551e8a85-a6b0-43ba-85da-645122f45bf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:38.346694 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-551e8a85-a6b0-43ba-85da-645122f45bf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:38.347314 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-551e8a85-a6b0-43ba-85da-645122f45bf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:38.540911 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-551e8a85-a6b0-43ba-85da-645122f45bf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:38.548187 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-551e8a85-a6b0-43ba-85da-645122f45bf9 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3" status: 200 len: 1515 microversion: 2.1 time: 0.214567 May 11 07:47:38.548758 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 414/827] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:38 2022] GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 => generated 1515 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:39.063290 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-279630695", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03fe8424-c7a4-4a16-bd46-5991849ceca4"}], "security_groups": [{"name": "tempest-securitygroup--2013121698"}], "key_name": "tempest-keypair-646184569", "user_data": "}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:39.166642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.network.neutron [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] validate_networks() for [('03fe8424-c7a4-4a16-bd46-5991849ceca4', None, None, None, None, None)] {{(pid=123600) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:47:39.514840 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Flavor limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:47:39.515415 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Image limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:47:39.515765 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Flavor pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:47:39.516172 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Image pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:47:39.516604 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:47:39.525187 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:39.525666 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:39.526478 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:39.526918 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:39.542673 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:47:39.546531 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for user cb737cfd514343dfbfbc30816cf5f655 and project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:47:39.557646 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Going to run 1 instances... {{(pid=123600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:47:39.559957 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:47:39.566725 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-687ce39d-4086-4747-87ec-d7da4ebfd77b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:39.567326 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-687ce39d-4086-4747-87ec-d7da4ebfd77b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:39.573625 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-687ce39d-4086-4747-87ec-d7da4ebfd77b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:39.574073 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-687ce39d-4086-4747-87ec-d7da4ebfd77b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:39.574831 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-687ce39d-4086-4747-87ec-d7da4ebfd77b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:39.575286 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-687ce39d-4086-4747-87ec-d7da4ebfd77b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:39.606424 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-60f79037-dc89-4a43-a4d5-fac8da5d283c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.547827 May 11 07:47:39.612514 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 414/828] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:47:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:47:39.617485 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b1cc3150-3c70-4855-81f5-35296d078fba tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:39.618187 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-b1cc3150-3c70-4855-81f5-35296d078fba tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:39.681583 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-b1cc3150-3c70-4855-81f5-35296d078fba tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:39.688455 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-b1cc3150-3c70-4855-81f5-35296d078fba tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 200 len: 1240 microversion: 2.1 time: 0.074713 May 11 07:47:39.689342 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 415/829] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:39 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:39.742284 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-687ce39d-4086-4747-87ec-d7da4ebfd77b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:39.750173 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-687ce39d-4086-4747-87ec-d7da4ebfd77b tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3" status: 200 len: 1515 microversion: 2.1 time: 0.187972 May 11 07:47:39.750744 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 415/830] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:39 2022] GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:47:40.604353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-146ef8c1-2747-4ea7-a952-34051ea9f72b req-c3489e3f-2031-4c5c-af03-f05564616218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "888d3d7a-ba5f-448d-ac81-3bdaba0dacb3", "name": "network-vif-deleted", "tag": "0d6698f3-fb47-43e1-8466-1d905f7f9c2c"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:40.613144 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-146ef8c1-2747-4ea7-a952-34051ea9f72b req-c3489e3f-2031-4c5c-af03-f05564616218 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:40.613643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-146ef8c1-2747-4ea7-a952-34051ea9f72b req-c3489e3f-2031-4c5c-af03-f05564616218 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:40.625461 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-146ef8c1-2747-4ea7-a952-34051ea9f72b req-c3489e3f-2031-4c5c-af03-f05564616218 service nova] Creating event network-vif-deleted:0d6698f3-fb47-43e1-8466-1d905f7f9c2c for instance 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 on hv-cinder-83699 May 11 07:47:40.632187 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-146ef8c1-2747-4ea7-a952-34051ea9f72b req-c3489e3f-2031-4c5c-af03-f05564616218 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031331 May 11 07:47:40.636256 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 416/831] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:40.706506 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-9f443f5a-743c-4d11-ab36-68b71949dd6d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:40.707482 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-9f443f5a-743c-4d11-ab36-68b71949dd6d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:40.713555 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9f443f5a-743c-4d11-ab36-68b71949dd6d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:40.714013 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9f443f5a-743c-4d11-ab36-68b71949dd6d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:40.714791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9f443f5a-743c-4d11-ab36-68b71949dd6d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:40.715354 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-9f443f5a-743c-4d11-ab36-68b71949dd6d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:40.768602 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f1848023-8bed-4584-b182-5a88c5b6be90 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:40.769466 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f1848023-8bed-4584-b182-5a88c5b6be90 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:40.776331 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f1848023-8bed-4584-b182-5a88c5b6be90 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:40.776779 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f1848023-8bed-4584-b182-5a88c5b6be90 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:40.777562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f1848023-8bed-4584-b182-5a88c5b6be90 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:40.778010 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f1848023-8bed-4584-b182-5a88c5b6be90 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:40.799462 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-9f443f5a-743c-4d11-ab36-68b71949dd6d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:40.807952 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-9f443f5a-743c-4d11-ab36-68b71949dd6d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 200 len: 1310 microversion: 2.1 time: 0.105997 May 11 07:47:40.808528 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 416/832] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:40 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 1310 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:40.808934 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f1848023-8bed-4584-b182-5a88c5b6be90 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:40.809390 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f1848023-8bed-4584-b182-5a88c5b6be90 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:40.809903 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.objects.instance [None req-f1848023-8bed-4584-b182-5a88c5b6be90 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lazy-loading 'fault' on Instance uuid 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 {{(pid=123600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:47:40.850941 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-f1848023-8bed-4584-b182-5a88c5b6be90 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b0351ac4564043b97f5499679cdc06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4410fd6b2c46da89537b4923db6d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:40.858164 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f1848023-8bed-4584-b182-5a88c5b6be90 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3" status: 200 len: 1309 microversion: 2.1 time: 0.094575 May 11 07:47:40.858715 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 417/833] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:40 2022] GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:41.825575 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-02a9f94c-69a3-49a3-86d5-36cf3316317b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:41.826290 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-02a9f94c-69a3-49a3-86d5-36cf3316317b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:41.833087 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-02a9f94c-69a3-49a3-86d5-36cf3316317b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:41.833641 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-02a9f94c-69a3-49a3-86d5-36cf3316317b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:41.834482 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-02a9f94c-69a3-49a3-86d5-36cf3316317b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:41.834993 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-02a9f94c-69a3-49a3-86d5-36cf3316317b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:41.875290 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a0412cb1-fa6d-4f6f-adea-dfc9532dd712 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:41.875985 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a0412cb1-fa6d-4f6f-adea-dfc9532dd712 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] [instance: 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:41.881946 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a0412cb1-fa6d-4f6f-adea-dfc9532dd712 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:41.882405 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a0412cb1-fa6d-4f6f-adea-dfc9532dd712 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:41.883174 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a0412cb1-fa6d-4f6f-adea-dfc9532dd712 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:41.883642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a0412cb1-fa6d-4f6f-adea-dfc9532dd712 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:41.899087 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-a0412cb1-fa6d-4f6f-adea-dfc9532dd712 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] HTTP exception thrown: Instance 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 could not be found. May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a0412cb1-fa6d-4f6f-adea-dfc9532dd712 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Request method failure captured: May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 HTTP/1.1 May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2m5mlbIx7Q_dB5xmeNi51IT7PGGJUY1SK09J24u5eIsO6OPFpOYbQA7BJXfEL_jlB7Fx1KzlkH5jBW9nwtlY-mHBPpX70htut-eX2xhB61EPxQWe0vtKp5WZ4BGiE5M5y30qEW2RfnUxca8SrA-NmgkRKBKoeECkXhyLbw_RMGUKMM May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 0c4410fd6b2c46da89537b4923db6d89 May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-VolumesSnapshotTestJSON-350679859 May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:47:41.900722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:47:41.902362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0c4410fd6b2c46da89537b4923db6d89", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c4410fd6b2c46da89537b4923db6d89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0c4410fd6b2c46da89537b4923db6d89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0c4410fd6b2c46da89537b4923db6d89"}]}] May 11 07:47:41.902362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-VolumesSnapshotTestJSON-350679859 May 11 07:47:41.902362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 0c4410fd6b2c46da89537b4923db6d89 May 11 07:47:41.902362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-350679859 May 11 07:47:41.902362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-VolumesSnapshotTestJSON-350679859-project May 11 07:47:41.902362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:47:41.902362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:47:41.902362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: e1b0351ac4564043b97f5499679cdc06 May 11 07:47:41.902362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-VolumesSnapshotTestJSON-350679859-project May 11 07:47:41.902362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:47:41.902362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 could not be found. May 11 07:47:41.902362 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '888d3d7a-ba5f-448d-ac81-3bdaba0dacb3'} May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 could not be found. May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:47:41.903146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 could not be found. May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 could not be found. May 11 07:47:41.904456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:41.905557 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a0412cb1-fa6d-4f6f-adea-dfc9532dd712 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] Returning 404 to user: Instance 888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:47:41.905557 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a0412cb1-fa6d-4f6f-adea-dfc9532dd712 tempest-VolumesSnapshotTestJSON-350679859 tempest-VolumesSnapshotTestJSON-350679859-project] 10.222.0.36 "GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3" status: 404 len: 111 microversion: 2.1 time: 0.031298 May 11 07:47:41.905557 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 418/834] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:41 2022] GET /compute/v2.1/servers/888d3d7a-ba5f-448d-ac81-3bdaba0dacb3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 07:47:42.036584 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-02a9f94c-69a3-49a3-86d5-36cf3316317b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:42.044135 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-02a9f94c-69a3-49a3-86d5-36cf3316317b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 200 len: 1366 microversion: 2.1 time: 0.222434 May 11 07:47:42.045325 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 417/835] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:41 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:42.289488 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-5d41f725-10b5-425d-a264-3542b8ffc56c req-bd232f72-6120-4e70-ac60-8955f14a36b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61fe52bc-415c-4beb-8a2c-0098912a19b7", "tag": "e5a66135-3715-45be-a3c6-ff5be4199879"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:42.301772 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-5d41f725-10b5-425d-a264-3542b8ffc56c req-bd232f72-6120-4e70-ac60-8955f14a36b3 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:42.302489 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-5d41f725-10b5-425d-a264-3542b8ffc56c req-bd232f72-6120-4e70-ac60-8955f14a36b3 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:42.318583 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-5d41f725-10b5-425d-a264-3542b8ffc56c req-bd232f72-6120-4e70-ac60-8955f14a36b3 service nova] Creating event network-changed:e5a66135-3715-45be-a3c6-ff5be4199879 for instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 on hv-cinder-83699 May 11 07:47:42.323899 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-5d41f725-10b5-425d-a264-3542b8ffc56c req-bd232f72-6120-4e70-ac60-8955f14a36b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037848 May 11 07:47:42.324842 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 419/836] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:43.061074 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-17821d8c-eecb-47cc-89e2-d481fa7efd57 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:43.061663 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-17821d8c-eecb-47cc-89e2-d481fa7efd57 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:43.068203 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-17821d8c-eecb-47cc-89e2-d481fa7efd57 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:43.068651 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-17821d8c-eecb-47cc-89e2-d481fa7efd57 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:43.069409 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-17821d8c-eecb-47cc-89e2-d481fa7efd57 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:43.069873 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-17821d8c-eecb-47cc-89e2-d481fa7efd57 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:43.191680 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-17821d8c-eecb-47cc-89e2-d481fa7efd57 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:43.198906 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-17821d8c-eecb-47cc-89e2-d481fa7efd57 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 200 len: 1366 microversion: 2.1 time: 0.141696 May 11 07:47:43.199465 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 418/837] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:43 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:44.215602 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-35b46000-49e3-46db-bbb5-22c3a2b3320a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:44.216294 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-35b46000-49e3-46db-bbb5-22c3a2b3320a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:44.222754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-35b46000-49e3-46db-bbb5-22c3a2b3320a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:44.223197 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-35b46000-49e3-46db-bbb5-22c3a2b3320a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:44.223949 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-35b46000-49e3-46db-bbb5-22c3a2b3320a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:44.224385 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-35b46000-49e3-46db-bbb5-22c3a2b3320a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:44.348182 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-35b46000-49e3-46db-bbb5-22c3a2b3320a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:44.355294 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-35b46000-49e3-46db-bbb5-22c3a2b3320a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 200 len: 1366 microversion: 2.1 time: 0.143892 May 11 07:47:44.355845 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 420/838] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:44 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:45.372149 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d1a68126-9625-4493-9392-b66baf0d8b7b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:45.372754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d1a68126-9625-4493-9392-b66baf0d8b7b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:45.379595 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d1a68126-9625-4493-9392-b66baf0d8b7b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:45.380041 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d1a68126-9625-4493-9392-b66baf0d8b7b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:45.380803 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d1a68126-9625-4493-9392-b66baf0d8b7b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:45.381268 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d1a68126-9625-4493-9392-b66baf0d8b7b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:45.541627 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d1a68126-9625-4493-9392-b66baf0d8b7b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:45.550872 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d1a68126-9625-4493-9392-b66baf0d8b7b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 200 len: 1366 microversion: 2.1 time: 0.182525 May 11 07:47:45.551520 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 419/839] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:45 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:46.567805 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4be3b6c2-431e-4a37-8cff-cd26951e2c46 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:46.568413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4be3b6c2-431e-4a37-8cff-cd26951e2c46 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:46.574698 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4be3b6c2-431e-4a37-8cff-cd26951e2c46 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:46.575151 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4be3b6c2-431e-4a37-8cff-cd26951e2c46 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:46.575919 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4be3b6c2-431e-4a37-8cff-cd26951e2c46 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:46.576365 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4be3b6c2-431e-4a37-8cff-cd26951e2c46 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:47.016228 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4be3b6c2-431e-4a37-8cff-cd26951e2c46 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:47.023446 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4be3b6c2-431e-4a37-8cff-cd26951e2c46 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 200 len: 1366 microversion: 2.1 time: 0.459865 May 11 07:47:47.024001 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 421/840] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:46 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:47.395547 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-0af19bcd-78a9-465e-8a1e-b60add7df6bd req-8c71bdc8-0b30-4613-b182-57ba5ee537d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61fe52bc-415c-4beb-8a2c-0098912a19b7", "name": "network-vif-plugged", "status": "completed", "tag": "e5a66135-3715-45be-a3c6-ff5be4199879"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:47.405064 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-0af19bcd-78a9-465e-8a1e-b60add7df6bd req-8c71bdc8-0b30-4613-b182-57ba5ee537d5 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:47.405508 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-0af19bcd-78a9-465e-8a1e-b60add7df6bd req-8c71bdc8-0b30-4613-b182-57ba5ee537d5 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:47.417888 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-0af19bcd-78a9-465e-8a1e-b60add7df6bd req-8c71bdc8-0b30-4613-b182-57ba5ee537d5 service nova] Creating event network-vif-plugged:e5a66135-3715-45be-a3c6-ff5be4199879 for instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 on hv-cinder-83699 May 11 07:47:47.423376 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-0af19bcd-78a9-465e-8a1e-b60add7df6bd req-8c71bdc8-0b30-4613-b182-57ba5ee537d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033521 May 11 07:47:47.424956 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 420/841] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:48.040230 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-da3c22d8-f989-479c-a478-4ca4e99d6fe9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:48.040822 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-da3c22d8-f989-479c-a478-4ca4e99d6fe9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:48.047210 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-da3c22d8-f989-479c-a478-4ca4e99d6fe9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:48.047659 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-da3c22d8-f989-479c-a478-4ca4e99d6fe9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:48.048415 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-da3c22d8-f989-479c-a478-4ca4e99d6fe9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:48.048849 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-da3c22d8-f989-479c-a478-4ca4e99d6fe9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:48.178088 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d9270e58-de62-4f25-8a06-ed29d23e93ee tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:48.179725 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d9270e58-de62-4f25-8a06-ed29d23e93ee tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:48.187652 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d9270e58-de62-4f25-8a06-ed29d23e93ee tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:48.188665 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d9270e58-de62-4f25-8a06-ed29d23e93ee tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:48.190606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d9270e58-de62-4f25-8a06-ed29d23e93ee tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:48.191265 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d9270e58-de62-4f25-8a06-ed29d23e93ee tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:48.203597 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-da3c22d8-f989-479c-a478-4ca4e99d6fe9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:48.211978 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-da3c22d8-f989-479c-a478-4ca4e99d6fe9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 200 len: 1366 microversion: 2.1 time: 0.175642 May 11 07:47:48.212539 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 422/842] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:48 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:48.217147 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-d63f523a-8403-4b10-af54-ed74ff563042 req-e940b78d-2b7d-4bce-b16d-44fa9b7f3efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf448381-f7a1-48de-b1a3-4c4fff939b95", "tag": "b4036bf3-ceea-472d-ac6d-ec2df0d52432"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:48.225297 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-d63f523a-8403-4b10-af54-ed74ff563042 req-e940b78d-2b7d-4bce-b16d-44fa9b7f3efa service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:48.225509 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d9270e58-de62-4f25-8a06-ed29d23e93ee tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Going to try to terminate instance {{(pid=123599) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:47:48.225772 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-d63f523a-8403-4b10-af54-ed74ff563042 req-e940b78d-2b7d-4bce-b16d-44fa9b7f3efa service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:48.236982 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-d63f523a-8403-4b10-af54-ed74ff563042 req-e940b78d-2b7d-4bce-b16d-44fa9b7f3efa service nova] Creating event network-changed:b4036bf3-ceea-472d-ac6d-ec2df0d52432 for instance bf448381-f7a1-48de-b1a3-4c4fff939b95 on hv-cinder-83699 May 11 07:47:48.242427 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-d63f523a-8403-4b10-af54-ed74ff563042 req-e940b78d-2b7d-4bce-b16d-44fa9b7f3efa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028622 May 11 07:47:48.243357 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 423/843] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:48.305194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d9270e58-de62-4f25-8a06-ed29d23e93ee tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 204 len: 0 microversion: 2.1 time: 0.131342 May 11 07:47:48.309030 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 421/844] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:47:48 2022] DELETE /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 07:47:48.314674 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3fa041a7-2e94-4993-8b37-3c346952a7be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:48.315631 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3fa041a7-2e94-4993-8b37-3c346952a7be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:48.321780 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3fa041a7-2e94-4993-8b37-3c346952a7be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:48.322236 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3fa041a7-2e94-4993-8b37-3c346952a7be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:48.323017 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3fa041a7-2e94-4993-8b37-3c346952a7be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:48.323480 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3fa041a7-2e94-4993-8b37-3c346952a7be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:48.488754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3fa041a7-2e94-4993-8b37-3c346952a7be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:48.496012 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3fa041a7-2e94-4993-8b37-3c346952a7be tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1574 microversion: 2.1 time: 0.185602 May 11 07:47:48.496582 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 424/845] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:48 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:47:49.229945 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-f0c43dbc-d305-4c00-876f-f80ef4548906 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:49.230772 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-f0c43dbc-d305-4c00-876f-f80ef4548906 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:49.237470 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f0c43dbc-d305-4c00-876f-f80ef4548906 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:49.238001 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f0c43dbc-d305-4c00-876f-f80ef4548906 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:49.238771 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f0c43dbc-d305-4c00-876f-f80ef4548906 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:49.239209 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f0c43dbc-d305-4c00-876f-f80ef4548906 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:49.366007 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-f0c43dbc-d305-4c00-876f-f80ef4548906 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:49.373318 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-f0c43dbc-d305-4c00-876f-f80ef4548906 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 200 len: 1366 microversion: 2.1 time: 0.147914 May 11 07:47:49.373921 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 422/846] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:49 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:49.513427 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-163086f1-6cd7-43ed-8041-95e6c2d71420 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:49.514066 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-163086f1-6cd7-43ed-8041-95e6c2d71420 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:49.520951 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-163086f1-6cd7-43ed-8041-95e6c2d71420 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:49.521402 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-163086f1-6cd7-43ed-8041-95e6c2d71420 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:49.522210 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-163086f1-6cd7-43ed-8041-95e6c2d71420 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:49.522646 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-163086f1-6cd7-43ed-8041-95e6c2d71420 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:49.647643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-163086f1-6cd7-43ed-8041-95e6c2d71420 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:49.654957 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-163086f1-6cd7-43ed-8041-95e6c2d71420 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1574 microversion: 2.1 time: 0.145381 May 11 07:47:49.655508 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 425/847] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:49 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1574 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:50.391949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-0da1f892-8a87-4d4c-baab-25a3d593fd3b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:50.393188 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-0da1f892-8a87-4d4c-baab-25a3d593fd3b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:50.399499 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0da1f892-8a87-4d4c-baab-25a3d593fd3b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:50.400017 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0da1f892-8a87-4d4c-baab-25a3d593fd3b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:50.400786 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0da1f892-8a87-4d4c-baab-25a3d593fd3b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:50.401218 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-0da1f892-8a87-4d4c-baab-25a3d593fd3b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:50.622841 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-0da1f892-8a87-4d4c-baab-25a3d593fd3b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:50.630920 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0da1f892-8a87-4d4c-baab-25a3d593fd3b tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 200 len: 1557 microversion: 2.1 time: 0.243898 May 11 07:47:50.631507 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 423/848] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:50 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 1557 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:50.648497 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-01f3f0a7-cff4-45af-abd0-14fd2c3df134 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:50.649133 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-01f3f0a7-cff4-45af-abd0-14fd2c3df134 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:50.655989 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-01f3f0a7-cff4-45af-abd0-14fd2c3df134 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:50.656614 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-01f3f0a7-cff4-45af-abd0-14fd2c3df134 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:50.657491 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-01f3f0a7-cff4-45af-abd0-14fd2c3df134 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:50.658102 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-01f3f0a7-cff4-45af-abd0-14fd2c3df134 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:50.674662 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d1ef6b8e-5dfd-4629-84a7-b3382a865bf9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:50.676026 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d1ef6b8e-5dfd-4629-84a7-b3382a865bf9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:50.684195 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d1ef6b8e-5dfd-4629-84a7-b3382a865bf9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:50.685014 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d1ef6b8e-5dfd-4629-84a7-b3382a865bf9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:50.686268 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d1ef6b8e-5dfd-4629-84a7-b3382a865bf9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:50.686944 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d1ef6b8e-5dfd-4629-84a7-b3382a865bf9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:50.799834 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-01f3f0a7-cff4-45af-abd0-14fd2c3df134 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.155290 May 11 07:47:50.800426 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 426/849] 10.222.0.36 () {58 vars in 1274 bytes} [Wed May 11 07:47:50 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:50.995865 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-d1ef6b8e-5dfd-4629-84a7-b3382a865bf9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:51.004910 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d1ef6b8e-5dfd-4629-84a7-b3382a865bf9 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 200 len: 1574 microversion: 2.1 time: 0.335061 May 11 07:47:51.005927 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 424/850] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:50 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 1574 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:47:51.122753 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-095f9210-7783-4c19-ab93-6d72ec1e31a1 req-8c3ad7c3-09d6-4970-867d-ab81181f0655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf448381-f7a1-48de-b1a3-4c4fff939b95", "name": "network-vif-deleted", "tag": "b4036bf3-ceea-472d-ac6d-ec2df0d52432"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:51.131323 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-095f9210-7783-4c19-ab93-6d72ec1e31a1 req-8c3ad7c3-09d6-4970-867d-ab81181f0655 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:51.131980 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-095f9210-7783-4c19-ab93-6d72ec1e31a1 req-8c3ad7c3-09d6-4970-867d-ab81181f0655 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:51.143965 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-095f9210-7783-4c19-ab93-6d72ec1e31a1 req-8c3ad7c3-09d6-4970-867d-ab81181f0655 service nova] Creating event network-vif-deleted:b4036bf3-ceea-472d-ac6d-ec2df0d52432 for instance bf448381-f7a1-48de-b1a3-4c4fff939b95 on hv-cinder-83699 May 11 07:47:51.149098 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-095f9210-7783-4c19-ab93-6d72ec1e31a1 req-8c3ad7c3-09d6-4970-867d-ab81181f0655 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030127 May 11 07:47:51.149716 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 427/851] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:51.887353 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-c6064f07-4288-452c-991b-a81849285c1b req-860b3b29-be4b-4cf0-84ae-60138b34f9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61fe52bc-415c-4beb-8a2c-0098912a19b7", "tag": "e5a66135-3715-45be-a3c6-ff5be4199879"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:51.896724 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-c6064f07-4288-452c-991b-a81849285c1b req-860b3b29-be4b-4cf0-84ae-60138b34f9e8 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:51.897255 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-c6064f07-4288-452c-991b-a81849285c1b req-860b3b29-be4b-4cf0-84ae-60138b34f9e8 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:51.908343 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-c6064f07-4288-452c-991b-a81849285c1b req-860b3b29-be4b-4cf0-84ae-60138b34f9e8 service nova] Creating event network-changed:e5a66135-3715-45be-a3c6-ff5be4199879 for instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 on hv-cinder-83699 May 11 07:47:51.913201 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-c6064f07-4288-452c-991b-a81849285c1b req-860b3b29-be4b-4cf0-84ae-60138b34f9e8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029453 May 11 07:47:51.914073 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 425/852] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:52.023485 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-76299a8c-6a23-4474-a09b-492397615883 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:52.024277 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-76299a8c-6a23-4474-a09b-492397615883 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: bf448381-f7a1-48de-b1a3-4c4fff939b95] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:52.030642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-76299a8c-6a23-4474-a09b-492397615883 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:52.031102 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-76299a8c-6a23-4474-a09b-492397615883 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:52.031883 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-76299a8c-6a23-4474-a09b-492397615883 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:52.032326 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-76299a8c-6a23-4474-a09b-492397615883 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:52.045425 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-76299a8c-6a23-4474-a09b-492397615883 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] HTTP exception thrown: Instance bf448381-f7a1-48de-b1a3-4c4fff939b95 could not be found. May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-76299a8c-6a23-4474-a09b-492397615883 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Request method failure captured: May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 HTTP/1.1 May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2hnZTkv4g9BV5n-cbOPQ00L4l2-HTmWB9owZvJHm1tJ_wg87Z4Sr1LURPuL-oSU2aDDhC_-PYXVMaxM8-zOAcHvyarmXPQWfuYs-IAE_RTnXM3KCWHI4mmn841AmZTVHCscJvTgQkbqvxVEn_bTeS-eA7CejvixEGNMBAPK-xmAOUY May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: d69ae02f1e0146c795d799160ac17d44 May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-TestVolumeBootPattern-1927038692 May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:47:52.047116 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:47:52.048745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d69ae02f1e0146c795d799160ac17d44", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d69ae02f1e0146c795d799160ac17d44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d69ae02f1e0146c795d799160ac17d44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d69ae02f1e0146c795d799160ac17d44"}]}] May 11 07:47:52.048745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-TestVolumeBootPattern-1927038692 May 11 07:47:52.048745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: d69ae02f1e0146c795d799160ac17d44 May 11 07:47:52.048745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-TestVolumeBootPattern-1927038692 May 11 07:47:52.048745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-TestVolumeBootPattern-1927038692-project May 11 07:47:52.048745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:47:52.048745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:47:52.048745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: ed2dae16f03c4eff9185087ed50120fc May 11 07:47:52.048745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-TestVolumeBootPattern-1927038692-project May 11 07:47:52.048745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:47:52.048745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance bf448381-f7a1-48de-b1a3-4c4fff939b95 could not be found. May 11 07:47:52.048745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': 'bf448381-f7a1-48de-b1a3-4c4fff939b95'} May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf448381-f7a1-48de-b1a3-4c4fff939b95 could not be found. May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:47:52.049565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf448381-f7a1-48de-b1a3-4c4fff939b95 could not be found. May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf448381-f7a1-48de-b1a3-4c4fff939b95 could not be found. May 11 07:47:52.051063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:47:52.052169 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-76299a8c-6a23-4474-a09b-492397615883 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Returning 404 to user: Instance bf448381-f7a1-48de-b1a3-4c4fff939b95 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:47:52.052169 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-76299a8c-6a23-4474-a09b-492397615883 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95" status: 404 len: 111 microversion: 2.1 time: 0.029773 May 11 07:47:52.052169 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 428/853] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:52 2022] GET /compute/v2.1/servers/bf448381-f7a1-48de-b1a3-4c4fff939b95 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:47:57.207440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c92b09ea-89a9-4718-8ffb-520b6b925806 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:57.213871 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-e8a9c61a-b60b-4b12-89e8-19535bee3f23 req-263e5bc3-b230-45cf-97b2-8b3c9a4793b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69085008-f940-4f96-936a-e0311df279c7", "tag": "a2bb40c8-8fd7-4b35-a542-bf1d3ba6c9e4"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:57.218830 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-c92b09ea-89a9-4718-8ffb-520b6b925806 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:57.226726 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-e8a9c61a-b60b-4b12-89e8-19535bee3f23 req-263e5bc3-b230-45cf-97b2-8b3c9a4793b0 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:57.227155 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c92b09ea-89a9-4718-8ffb-520b6b925806 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:57.227590 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-e8a9c61a-b60b-4b12-89e8-19535bee3f23 req-263e5bc3-b230-45cf-97b2-8b3c9a4793b0 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:57.227796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c92b09ea-89a9-4718-8ffb-520b6b925806 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:57.228612 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c92b09ea-89a9-4718-8ffb-520b6b925806 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:57.229106 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c92b09ea-89a9-4718-8ffb-520b6b925806 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:57.239644 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-e8a9c61a-b60b-4b12-89e8-19535bee3f23 req-263e5bc3-b230-45cf-97b2-8b3c9a4793b0 service nova] Creating event network-changed:a2bb40c8-8fd7-4b35-a542-bf1d3ba6c9e4 for instance 69085008-f940-4f96-936a-e0311df279c7 on hv-cinder-83699 May 11 07:47:57.245100 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-e8a9c61a-b60b-4b12-89e8-19535bee3f23 req-263e5bc3-b230-45cf-97b2-8b3c9a4793b0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035735 May 11 07:47:57.246371 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 429/854] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:57.262922 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-c92b09ea-89a9-4718-8ffb-520b6b925806 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Going to try to terminate instance {{(pid=123599) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:47:57.352185 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c92b09ea-89a9-4718-8ffb-520b6b925806 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "DELETE /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 204 len: 0 microversion: 2.1 time: 0.149294 May 11 07:47:57.353157 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 426/855] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:47:57 2022] DELETE /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:47:57.362785 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-0bc56f60-61e8-4e32-9b88-7feeb7363e25 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:57.363760 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-0bc56f60-61e8-4e32-9b88-7feeb7363e25 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:57.370395 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0bc56f60-61e8-4e32-9b88-7feeb7363e25 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:57.371064 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0bc56f60-61e8-4e32-9b88-7feeb7363e25 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:57.371847 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0bc56f60-61e8-4e32-9b88-7feeb7363e25 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:57.372290 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-0bc56f60-61e8-4e32-9b88-7feeb7363e25 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:57.507998 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-0bc56f60-61e8-4e32-9b88-7feeb7363e25 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:57.515385 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-0bc56f60-61e8-4e32-9b88-7feeb7363e25 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1576 microversion: 2.1 time: 0.157744 May 11 07:47:57.515866 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 430/856] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:57 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:47:58.534055 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3dae762d-ab36-40b6-9719-9ab76c6cd1b7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:58.534832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-3dae762d-ab36-40b6-9719-9ab76c6cd1b7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:58.541027 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3dae762d-ab36-40b6-9719-9ab76c6cd1b7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:58.541468 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3dae762d-ab36-40b6-9719-9ab76c6cd1b7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:58.542262 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3dae762d-ab36-40b6-9719-9ab76c6cd1b7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:58.542692 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3dae762d-ab36-40b6-9719-9ab76c6cd1b7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:58.672774 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-3dae762d-ab36-40b6-9719-9ab76c6cd1b7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:58.680683 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-3dae762d-ab36-40b6-9719-9ab76c6cd1b7 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1576 microversion: 2.1 time: 0.150833 May 11 07:47:58.681247 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 427/857] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:58 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:47:59.643867 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-bf9e11e1-ae37-4d3b-b028-139a2895e95e req-2d1b7f41-5ed4-4bb5-a4ac-4f83ef800eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69085008-f940-4f96-936a-e0311df279c7", "name": "network-vif-deleted", "tag": "a2bb40c8-8fd7-4b35-a542-bf1d3ba6c9e4"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:47:59.653105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-bf9e11e1-ae37-4d3b-b028-139a2895e95e req-2d1b7f41-5ed4-4bb5-a4ac-4f83ef800eae service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:59.653558 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-bf9e11e1-ae37-4d3b-b028-139a2895e95e req-2d1b7f41-5ed4-4bb5-a4ac-4f83ef800eae service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:59.664914 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-bf9e11e1-ae37-4d3b-b028-139a2895e95e req-2d1b7f41-5ed4-4bb5-a4ac-4f83ef800eae service nova] Creating event network-vif-deleted:a2bb40c8-8fd7-4b35-a542-bf1d3ba6c9e4 for instance 69085008-f940-4f96-936a-e0311df279c7 on hv-cinder-83699 May 11 07:47:59.669704 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-bf9e11e1-ae37-4d3b-b028-139a2895e95e req-2d1b7f41-5ed4-4bb5-a4ac-4f83ef800eae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029478 May 11 07:47:59.670281 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 431/858] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:47:59.699099 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-82ce6d5b-f83c-4bc3-8159-17cfca0f8815 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:47:59.700263 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-82ce6d5b-f83c-4bc3-8159-17cfca0f8815 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:47:59.707529 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-82ce6d5b-f83c-4bc3-8159-17cfca0f8815 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:59.707972 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-82ce6d5b-f83c-4bc3-8159-17cfca0f8815 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:59.708879 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-82ce6d5b-f83c-4bc3-8159-17cfca0f8815 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:47:59.709447 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-82ce6d5b-f83c-4bc3-8159-17cfca0f8815 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:47:59.770420 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-82ce6d5b-f83c-4bc3-8159-17cfca0f8815 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed2dae16f03c4eff9185087ed50120fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69ae02f1e0146c795d799160ac17d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:47:59.777856 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-82ce6d5b-f83c-4bc3-8159-17cfca0f8815 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 200 len: 1225 microversion: 2.1 time: 0.084010 May 11 07:47:59.778596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 428/859] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:47:59 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:48:00.796212 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-342abaad-40f3-412e-96b5-2175900433bc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:00.796832 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-342abaad-40f3-412e-96b5-2175900433bc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 69085008-f940-4f96-936a-e0311df279c7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:00.803463 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-342abaad-40f3-412e-96b5-2175900433bc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:00.803918 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-342abaad-40f3-412e-96b5-2175900433bc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:00.804682 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-342abaad-40f3-412e-96b5-2175900433bc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:00.805123 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-342abaad-40f3-412e-96b5-2175900433bc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:00.818722 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-342abaad-40f3-412e-96b5-2175900433bc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] HTTP exception thrown: Instance 69085008-f940-4f96-936a-e0311df279c7 could not be found. May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-342abaad-40f3-412e-96b5-2175900433bc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Request method failure captured: May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 HTTP/1.1 May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2hnZTkv4g9BV5n-cbOPQ00L4l2-HTmWB9owZvJHm1tJ_wg87Z4Sr1LURPuL-oSU2aDDhC_-PYXVMaxM8-zOAcHvyarmXPQWfuYs-IAE_RTnXM3KCWHI4mmn841AmZTVHCscJvTgQkbqvxVEn_bTeS-eA7CejvixEGNMBAPK-xmAOUY May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: d69ae02f1e0146c795d799160ac17d44 May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-TestVolumeBootPattern-1927038692 May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:48:00.820320 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:48:00.821917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d69ae02f1e0146c795d799160ac17d44", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d69ae02f1e0146c795d799160ac17d44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d69ae02f1e0146c795d799160ac17d44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d69ae02f1e0146c795d799160ac17d44"}]}] May 11 07:48:00.821917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-TestVolumeBootPattern-1927038692 May 11 07:48:00.821917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: d69ae02f1e0146c795d799160ac17d44 May 11 07:48:00.821917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-TestVolumeBootPattern-1927038692 May 11 07:48:00.821917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-TestVolumeBootPattern-1927038692-project May 11 07:48:00.821917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:48:00.821917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:48:00.821917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: ed2dae16f03c4eff9185087ed50120fc May 11 07:48:00.821917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-TestVolumeBootPattern-1927038692-project May 11 07:48:00.821917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:48:00.821917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 69085008-f940-4f96-936a-e0311df279c7 could not be found. May 11 07:48:00.821917 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '69085008-f940-4f96-936a-e0311df279c7'} May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69085008-f940-4f96-936a-e0311df279c7 could not be found. May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:48:00.822915 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69085008-f940-4f96-936a-e0311df279c7 could not be found. May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69085008-f940-4f96-936a-e0311df279c7 could not be found. May 11 07:48:00.824353 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:00.826074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-342abaad-40f3-412e-96b5-2175900433bc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Returning 404 to user: Instance 69085008-f940-4f96-936a-e0311df279c7 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:48:00.826074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-342abaad-40f3-412e-96b5-2175900433bc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7" status: 404 len: 111 microversion: 2.1 time: 0.030222 May 11 07:48:00.826074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 432/860] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:00 2022] GET /compute/v2.1/servers/69085008-f940-4f96-936a-e0311df279c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:48:01.254500 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-11825cc1-336e-43c8-b539-2e03d1474453 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:01.255002 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-11825cc1-336e-43c8-b539-2e03d1474453 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:01.261216 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-11825cc1-336e-43c8-b539-2e03d1474453 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:01.261696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-11825cc1-336e-43c8-b539-2e03d1474453 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:01.262673 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-11825cc1-336e-43c8-b539-2e03d1474453 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:01.263114 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-11825cc1-336e-43c8-b539-2e03d1474453 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:01.276195 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-11825cc1-336e-43c8-b539-2e03d1474453 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] HTTP exception thrown: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-11825cc1-336e-43c8-b539-2e03d1474453 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Request method failure captured: May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: DELETE /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 HTTP/1.1 May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2hnZTkv4g9BV5n-cbOPQ00L4l2-HTmWB9owZvJHm1tJ_wg87Z4Sr1LURPuL-oSU2aDDhC_-PYXVMaxM8-zOAcHvyarmXPQWfuYs-IAE_RTnXM3KCWHI4mmn841AmZTVHCscJvTgQkbqvxVEn_bTeS-eA7CejvixEGNMBAPK-xmAOUY May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: d69ae02f1e0146c795d799160ac17d44 May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-TestVolumeBootPattern-1927038692 May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:48:01.277834 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:48:01.279439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d69ae02f1e0146c795d799160ac17d44", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d69ae02f1e0146c795d799160ac17d44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d69ae02f1e0146c795d799160ac17d44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d69ae02f1e0146c795d799160ac17d44"}]}] May 11 07:48:01.279439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-TestVolumeBootPattern-1927038692 May 11 07:48:01.279439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: d69ae02f1e0146c795d799160ac17d44 May 11 07:48:01.279439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-TestVolumeBootPattern-1927038692 May 11 07:48:01.279439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-TestVolumeBootPattern-1927038692-project May 11 07:48:01.279439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:48:01.279439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:48:01.279439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: ed2dae16f03c4eff9185087ed50120fc May 11 07:48:01.279439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-TestVolumeBootPattern-1927038692-project May 11 07:48:01.279439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:48:01.279439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:48:01.279439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0'} May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:48:01.280183 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:48:01.281408 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:48:01.283017 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-11825cc1-336e-43c8-b539-2e03d1474453 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Returning 404 to user: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:48:01.283017 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-11825cc1-336e-43c8-b539-2e03d1474453 tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "DELETE /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 404 len: 111 microversion: 2.1 time: 0.028564 May 11 07:48:01.283017 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 429/861] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:48:01 2022] DELETE /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:48:01.288415 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1d0daec2-8f56-4374-a92d-d90b70b3cfdc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:01.289122 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-1d0daec2-8f56-4374-a92d-d90b70b3cfdc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] [instance: 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:01.295074 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1d0daec2-8f56-4374-a92d-d90b70b3cfdc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:01.295532 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1d0daec2-8f56-4374-a92d-d90b70b3cfdc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:01.296352 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1d0daec2-8f56-4374-a92d-d90b70b3cfdc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:01.296847 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1d0daec2-8f56-4374-a92d-d90b70b3cfdc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:01.310617 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-1d0daec2-8f56-4374-a92d-d90b70b3cfdc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] HTTP exception thrown: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1d0daec2-8f56-4374-a92d-d90b70b3cfdc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Request method failure captured: May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 HTTP/1.1 May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2hnZTkv4g9BV5n-cbOPQ00L4l2-HTmWB9owZvJHm1tJ_wg87Z4Sr1LURPuL-oSU2aDDhC_-PYXVMaxM8-zOAcHvyarmXPQWfuYs-IAE_RTnXM3KCWHI4mmn841AmZTVHCscJvTgQkbqvxVEn_bTeS-eA7CejvixEGNMBAPK-xmAOUY May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: d69ae02f1e0146c795d799160ac17d44 May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-TestVolumeBootPattern-1927038692 May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:48:01.312159 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:48:01.313691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d69ae02f1e0146c795d799160ac17d44", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d69ae02f1e0146c795d799160ac17d44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d69ae02f1e0146c795d799160ac17d44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d69ae02f1e0146c795d799160ac17d44"}]}] May 11 07:48:01.313691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-TestVolumeBootPattern-1927038692 May 11 07:48:01.313691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: d69ae02f1e0146c795d799160ac17d44 May 11 07:48:01.313691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-TestVolumeBootPattern-1927038692 May 11 07:48:01.313691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-TestVolumeBootPattern-1927038692-project May 11 07:48:01.313691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:48:01.313691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:48:01.313691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: ed2dae16f03c4eff9185087ed50120fc May 11 07:48:01.313691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-TestVolumeBootPattern-1927038692-project May 11 07:48:01.313691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:48:01.313691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:48:01.313691 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0'} May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:48:01.314484 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. May 11 07:48:01.315961 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:01.317011 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1d0daec2-8f56-4374-a92d-d90b70b3cfdc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Returning 404 to user: Instance 021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:48:01.317011 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-1d0daec2-8f56-4374-a92d-d90b70b3cfdc tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0" status: 404 len: 111 microversion: 2.1 time: 0.029681 May 11 07:48:01.317011 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 433/862] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:01 2022] GET /compute/v2.1/servers/021f7321-4ad7-4e1b-b6a1-0f6cf59b88a0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:48:02.586949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-f22e2190-d91f-45cb-b173-ab2e17bd6a8a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] Calling method '.version_select at 0x7f19ec889f70>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:02.605828 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-f22e2190-d91f-45cb-b173-ab2e17bd6a8a tempest-TestVolumeBootPattern-1927038692 tempest-TestVolumeBootPattern-1927038692-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-678948032" status: 202 len: 0 microversion: 2.1 time: 0.022477 May 11 07:48:02.606414 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 430/863] 10.222.0.36 () {58 vars in 1259 bytes} [Wed May 11 07:48:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-678948032 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:48:28.015740 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d5ec9fd9-bbac-41e1-be9c-a2d61ef0f7d4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:28.016359 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d5ec9fd9-bbac-41e1-be9c-a2d61ef0f7d4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:28.023134 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d5ec9fd9-bbac-41e1-be9c-a2d61ef0f7d4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:28.023589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d5ec9fd9-bbac-41e1-be9c-a2d61ef0f7d4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:28.024360 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d5ec9fd9-bbac-41e1-be9c-a2d61ef0f7d4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:28.024802 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d5ec9fd9-bbac-41e1-be9c-a2d61ef0f7d4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:28.047644 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d5ec9fd9-bbac-41e1-be9c-a2d61ef0f7d4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/ips" status: 200 len: 151 microversion: 2.1 time: 0.035809 May 11 07:48:28.048196 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 434/864] 10.222.0.36 () {58 vars in 1247 bytes} [Wed May 11 07:48:28 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:48:29.358637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-68382b6f-521a-4353-869c-5e06e94b8071 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "814d7825-77bf-4246-a657-1f42a2a02f73"}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:48:29.359676 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-68382b6f-521a-4353-869c-5e06e94b8071 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:29.366743 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-68382b6f-521a-4353-869c-5e06e94b8071 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:29.367192 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-68382b6f-521a-4353-869c-5e06e94b8071 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:29.367955 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-68382b6f-521a-4353-869c-5e06e94b8071 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:29.368387 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-68382b6f-521a-4353-869c-5e06e94b8071 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:29.790964 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-68382b6f-521a-4353-869c-5e06e94b8071 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "POST /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.436792 May 11 07:48:29.791577 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 431/865] 10.222.0.36 () {60 vars in 1322 bytes} [Wed May 11 07:48:29 2022] POST /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/os-volume_attachments => generated 194 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:48:37.256924 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-07b3c934-62aa-4bdd-b014-51d4b694dc91 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "814d7825-77bf-4246-a657-1f42a2a02f73"}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:48:37.258041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-07b3c934-62aa-4bdd-b014-51d4b694dc91 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:37.264440 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-07b3c934-62aa-4bdd-b014-51d4b694dc91 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:37.264884 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-07b3c934-62aa-4bdd-b014-51d4b694dc91 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:37.265668 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-07b3c934-62aa-4bdd-b014-51d4b694dc91 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:37.266105 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-07b3c934-62aa-4bdd-b014-51d4b694dc91 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:37.395318 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-07b3c934-62aa-4bdd-b014-51d4b694dc91 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] HTTP exception thrown: Invalid volume: volume 814d7825-77bf-4246-a657-1f42a2a02f73 is already attached to instances: 61fe52bc-415c-4beb-8a2c-0098912a19b7 May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-07b3c934-62aa-4bdd-b014-51d4b694dc91 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Request method failure captured: May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: POST /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/os-volume_attachments HTTP/1.1 May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 74 May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2mEHqQL-u3ouRY26Qw00htshbb-Yff6Ho3PvS4ty6HQr0GnvWuxtj6K5fRiT6sYE4t3AbTSvAlw3oMBLjIhYarCsmhj2jk7lLeHkyPOY-QXvOFSOdAVZ-fXXXrmiCClFSyTB3XsO_5HsLGbCQ8V4LKdnzODb28mc4LszNG8l56As9U May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:48:37.397176 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:48:37.398875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbefc9c91dab46baa2707f01c83e48e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}] May 11 07:48:37.398875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:48:37.398875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:48:37.398875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:48:37.398875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:48:37.398875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:48:37.398875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:48:37.398875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: cb737cfd514343dfbfbc30816cf5f655 May 11 07:48:37.398875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:48:37.398875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: May 11 07:48:37.398875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {"volumeAttachment": {"volumeId": "814d7825-77bf-4246-a657-1f42a2a02f73"}} May 11 07:48:37.398875 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Invalid volume: volume 814d7825-77bf-4246-a657-1f42a2a02f73 is already attached to instances: 61fe52bc-415c-4beb-8a2c-0098912a19b7 May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'server_id': '61fe52bc-415c-4beb-8a2c-0098912a19b7', 'body': {'volumeAttachment': {'volumeId': '814d7825-77bf-4246-a657-1f42a2a02f73'}}} May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 814d7825-77bf-4246-a657-1f42a2a02f73 is already attached to instances: 61fe52bc-415c-4beb-8a2c-0098912a19b7 May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:37.399777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 814d7825-77bf-4246-a657-1f42a2a02f73 is already attached to instances: 61fe52bc-415c-4beb-8a2c-0098912a19b7 May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:37.401246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:48:37.402893 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:48:37.402893 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:48:37.402893 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:48:37.402893 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 814d7825-77bf-4246-a657-1f42a2a02f73 is already attached to instances: 61fe52bc-415c-4beb-8a2c-0098912a19b7 May 11 07:48:37.402893 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:48:37.402893 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-07b3c934-62aa-4bdd-b014-51d4b694dc91 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Returning 400 to user: Invalid volume: volume 814d7825-77bf-4246-a657-1f42a2a02f73 is already attached to instances: 61fe52bc-415c-4beb-8a2c-0098912a19b7 {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:48:37.402893 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-07b3c934-62aa-4bdd-b014-51d4b694dc91 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "POST /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.145707 May 11 07:48:37.402893 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 435/866] 10.222.0.36 () {60 vars in 1322 bytes} [Wed May 11 07:48:37 2022] POST /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/os-volume_attachments => generated 174 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 07:48:37.457750 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-f60a4f6d-8230-4ba2-9ee6-ae3e1ab2612c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:37.458318 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-f60a4f6d-8230-4ba2-9ee6-ae3e1ab2612c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:37.464300 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f60a4f6d-8230-4ba2-9ee6-ae3e1ab2612c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:37.464744 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f60a4f6d-8230-4ba2-9ee6-ae3e1ab2612c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:37.465498 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f60a4f6d-8230-4ba2-9ee6-ae3e1ab2612c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:37.465968 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f60a4f6d-8230-4ba2-9ee6-ae3e1ab2612c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:37.542249 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.objects.instance [None req-f60a4f6d-8230-4ba2-9ee6-ae3e1ab2612c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lazy-loading 'services' on Instance uuid 61fe52bc-415c-4beb-8a2c-0098912a19b7 {{(pid=123599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:48:37.609283 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-f60a4f6d-8230-4ba2-9ee6-ae3e1ab2612c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/os-volume_attachments/814d7825-77bf-4246-a657-1f42a2a02f73" status: 202 len: 0 microversion: 2.1 time: 0.156226 May 11 07:48:37.609883 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 432/867] 10.222.0.36 () {58 vars in 1415 bytes} [Wed May 11 07:48:37 2022] DELETE /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/os-volume_attachments/814d7825-77bf-4246-a657-1f42a2a02f73 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:48:37.618378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f122f6a6-0638-416b-a830-28fdf8c24076 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:37.619979 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f122f6a6-0638-416b-a830-28fdf8c24076 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:37.628774 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f122f6a6-0638-416b-a830-28fdf8c24076 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:37.629223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f122f6a6-0638-416b-a830-28fdf8c24076 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:37.630083 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f122f6a6-0638-416b-a830-28fdf8c24076 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:37.630521 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f122f6a6-0638-416b-a830-28fdf8c24076 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:37.661252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f122f6a6-0638-416b-a830-28fdf8c24076 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047034 May 11 07:48:37.661999 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 436/868] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:48:37 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:48:38.673825 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-258d9ac0-0b48-4b18-8f1e-05ed2dd2d06d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:38.674914 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-258d9ac0-0b48-4b18-8f1e-05ed2dd2d06d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:38.681671 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-258d9ac0-0b48-4b18-8f1e-05ed2dd2d06d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:38.682116 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-258d9ac0-0b48-4b18-8f1e-05ed2dd2d06d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:38.682875 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-258d9ac0-0b48-4b18-8f1e-05ed2dd2d06d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:38.683305 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-258d9ac0-0b48-4b18-8f1e-05ed2dd2d06d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:38.710205 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-258d9ac0-0b48-4b18-8f1e-05ed2dd2d06d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041166 May 11 07:48:38.710730 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 433/869] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:48:38 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 07:48:38.765529 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-446d6a38-8d53-4d12-a922-18f9d3670fdc tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:38.766047 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-446d6a38-8d53-4d12-a922-18f9d3670fdc tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:38.772240 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-446d6a38-8d53-4d12-a922-18f9d3670fdc tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:38.772695 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-446d6a38-8d53-4d12-a922-18f9d3670fdc tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:38.773461 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-446d6a38-8d53-4d12-a922-18f9d3670fdc tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:38.773928 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-446d6a38-8d53-4d12-a922-18f9d3670fdc tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:38.797992 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-446d6a38-8d53-4d12-a922-18f9d3670fdc tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Going to try to terminate instance {{(pid=123600) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:48:38.870272 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-446d6a38-8d53-4d12-a922-18f9d3670fdc tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 204 len: 0 microversion: 2.1 time: 0.108179 May 11 07:48:38.871112 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 437/870] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:48:38 2022] DELETE /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:48:38.879176 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-c089167a-b911-4557-890f-d48c14969183 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:38.879833 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-c089167a-b911-4557-890f-d48c14969183 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:38.885606 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c089167a-b911-4557-890f-d48c14969183 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:38.886054 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c089167a-b911-4557-890f-d48c14969183 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:38.886811 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c089167a-b911-4557-890f-d48c14969183 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:38.887237 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-c089167a-b911-4557-890f-d48c14969183 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:39.016956 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-c089167a-b911-4557-890f-d48c14969183 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:48:39.025966 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-c089167a-b911-4557-890f-d48c14969183 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 200 len: 1682 microversion: 2.1 time: 0.150502 May 11 07:48:39.026537 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 434/871] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:38 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:48:39.386299 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 07:48:39.386522 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Wed May 11 07:48:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 07:48:40.043989 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-00bf88ec-f8e9-48b9-bd03-edbb09092b54 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:40.044679 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-00bf88ec-f8e9-48b9-bd03-edbb09092b54 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:40.051421 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00bf88ec-f8e9-48b9-bd03-edbb09092b54 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:40.051866 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00bf88ec-f8e9-48b9-bd03-edbb09092b54 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:40.052628 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00bf88ec-f8e9-48b9-bd03-edbb09092b54 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:40.053060 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-00bf88ec-f8e9-48b9-bd03-edbb09092b54 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:40.180977 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-00bf88ec-f8e9-48b9-bd03-edbb09092b54 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:48:40.188187 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-00bf88ec-f8e9-48b9-bd03-edbb09092b54 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 200 len: 1682 microversion: 2.1 time: 0.148434 May 11 07:48:40.188741 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 438/872] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:40 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:48:41.204591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-fffd7d00-f756-4e77-8ea5-cba390e8506c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:41.205313 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-fffd7d00-f756-4e77-8ea5-cba390e8506c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:41.212533 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fffd7d00-f756-4e77-8ea5-cba390e8506c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:41.213059 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fffd7d00-f756-4e77-8ea5-cba390e8506c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:41.213942 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fffd7d00-f756-4e77-8ea5-cba390e8506c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:41.214382 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fffd7d00-f756-4e77-8ea5-cba390e8506c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:41.275311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-fffd7d00-f756-4e77-8ea5-cba390e8506c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:48:41.282678 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-fffd7d00-f756-4e77-8ea5-cba390e8506c tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 200 len: 1614 microversion: 2.1 time: 0.081963 May 11 07:48:41.283247 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 435/873] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:41 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 1614 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:48:41.458053 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-5538d4e8-ffaa-4dd7-93fc-3017e3bac0c0 req-5d1c3127-28b5-4f50-967e-b1f9ee72ef18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61fe52bc-415c-4beb-8a2c-0098912a19b7", "name": "network-vif-deleted", "tag": "e5a66135-3715-45be-a3c6-ff5be4199879"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:48:41.469345 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-5538d4e8-ffaa-4dd7-93fc-3017e3bac0c0 req-5d1c3127-28b5-4f50-967e-b1f9ee72ef18 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:41.470358 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-5538d4e8-ffaa-4dd7-93fc-3017e3bac0c0 req-5d1c3127-28b5-4f50-967e-b1f9ee72ef18 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:41.483569 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-5538d4e8-ffaa-4dd7-93fc-3017e3bac0c0 req-5d1c3127-28b5-4f50-967e-b1f9ee72ef18 service nova] Creating event network-vif-deleted:e5a66135-3715-45be-a3c6-ff5be4199879 for instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 on hv-cinder-83699 May 11 07:48:41.488685 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-5538d4e8-ffaa-4dd7-93fc-3017e3bac0c0 req-5d1c3127-28b5-4f50-967e-b1f9ee72ef18 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037219 May 11 07:48:41.489359 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 439/874] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:48:42.299829 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b2c8a974-3238-4f82-b935-26ef73e7c832 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:42.300462 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-b2c8a974-3238-4f82-b935-26ef73e7c832 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:42.307410 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b2c8a974-3238-4f82-b935-26ef73e7c832 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:42.307853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b2c8a974-3238-4f82-b935-26ef73e7c832 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:42.308619 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b2c8a974-3238-4f82-b935-26ef73e7c832 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:42.309046 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b2c8a974-3238-4f82-b935-26ef73e7c832 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:42.323658 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-b2c8a974-3238-4f82-b935-26ef73e7c832 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] HTTP exception thrown: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b2c8a974-3238-4f82-b935-26ef73e7c832 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Request method failure captured: May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 HTTP/1.1 May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2mEHqQL-u3ouRY26Qw00htshbb-Yff6Ho3PvS4ty6HQr0GnvWuxtj6K5fRiT6sYE4t3AbTSvAlw3oMBLjIhYarCsmhj2jk7lLeHkyPOY-QXvOFSOdAVZ-fXXXrmiCClFSyTB3XsO_5HsLGbCQ8V4LKdnzODb28mc4LszNG8l56As9U May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:48:42.325311 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:48:42.326889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbefc9c91dab46baa2707f01c83e48e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}] May 11 07:48:42.326889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:48:42.326889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:48:42.326889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:48:42.326889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:48:42.326889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:48:42.326889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:48:42.326889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: cb737cfd514343dfbfbc30816cf5f655 May 11 07:48:42.326889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:48:42.326889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:48:42.326889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:48:42.326889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '61fe52bc-415c-4beb-8a2c-0098912a19b7'} May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:48:42.327788 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:48:42.329241 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:48:42.330957 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b2c8a974-3238-4f82-b935-26ef73e7c832 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Returning 404 to user: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:48:42.330957 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-b2c8a974-3238-4f82-b935-26ef73e7c832 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 404 len: 111 microversion: 2.1 time: 0.030843 May 11 07:48:42.330957 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 436/875] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:42 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:48:42.336392 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-31d457e0-18fe-4f4e-81ed-0d37848cdfab tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '.version_select at 0x7f19ec9a9700>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:42.353748 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-31d457e0-18fe-4f4e-81ed-0d37848cdfab tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-646184569" status: 202 len: 0 microversion: 2.1 time: 0.021408 May 11 07:48:42.354407 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 440/876] 10.222.0.36 () {58 vars in 1217 bytes} [Wed May 11 07:48:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-646184569 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 07:48:42.948597 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-58493845-5d7c-4d15-b66f-667df120a240 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Action: 'create', calling method: .version_select at 0x7f19ec8e23a0>, body: {"keypair": {"name": "tempest-keypair-1577577951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKCO51TD8Dxy4MhXxFq9e8fXFWxnBOUxMjDKfSYXXwovvXHLJ4nrJAFa08FAr22r1/IKwkaMOHPCQEKy0OjOT4T9skkbFn5cAVuTNv5omHvSWfqrZyp7xnVXMoGoaJfPQ=="}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:48:42.961903 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-58493845-5d7c-4d15-b66f-667df120a240 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:48:42.965416 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-58493845-5d7c-4d15-b66f-667df120a240 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for user cb737cfd514343dfbfbc30816cf5f655 and project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'key_pairs'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:48:42.985411 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-58493845-5d7c-4d15-b66f-667df120a240 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.040654 May 11 07:48:42.986007 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 437/877] 10.222.0.36 () {60 vars in 1158 bytes} [Wed May 11 07:48:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:48:44.227034 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-634783013", "imageRef": "2df22b3f-6605-4146-9b3e-dac922f7cd59", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03fe8424-c7a4-4a16-bd46-5991849ceca4"}], "security_groups": [{"name": "tempest-securitygroup--910077171"}], "key_name": "tempest-keypair-1577577951", "user_data": "}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:48:44.323972 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.network.neutron [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] validate_networks() for [('03fe8424-c7a4-4a16-bd46-5991849ceca4', None, None, None, None, None)] {{(pid=123600) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:48:44.680856 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Flavor limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:48:44.681278 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Image limits 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:48:44.681864 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Flavor pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:48:44.682276 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Image pref 0:0:0 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:48:44.682684 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.virt.hardware [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:48:44.691896 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:44.692348 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:44.693152 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:44.693624 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:44.710070 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:48:44.713947 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Getting quotas for user cb737cfd514343dfbfbc30816cf5f655 and project bbefc9c91dab46baa2707f01c83e48e2. Resources: {'instances', 'ram', 'cores'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:48:44.724536 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Going to run 1 instances... {{(pid=123600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:48:44.726870 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2df22b3f-6605-4146-9b3e-dac922f7cd59',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:48:44.772293 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-640a9475-1ee1-4770-97af-35f2a4d1ec96 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.549946 May 11 07:48:44.772939 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 441/878] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:48:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:48:44.783322 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ee355f56-87c0-4343-9a34-bb59da999a6a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:44.783928 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ee355f56-87c0-4343-9a34-bb59da999a6a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:44.835751 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-ee355f56-87c0-4343-9a34-bb59da999a6a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:48:44.842980 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ee355f56-87c0-4343-9a34-bb59da999a6a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 200 len: 1241 microversion: 2.1 time: 0.063921 May 11 07:48:44.843460 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 438/879] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:44 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:48:45.859391 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8e2e1974-1493-4aa4-b537-5c5c7cf7bb8f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:45.859942 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8e2e1974-1493-4aa4-b537-5c5c7cf7bb8f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:45.868075 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8e2e1974-1493-4aa4-b537-5c5c7cf7bb8f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:45.868805 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8e2e1974-1493-4aa4-b537-5c5c7cf7bb8f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:45.869798 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8e2e1974-1493-4aa4-b537-5c5c7cf7bb8f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:45.871152 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8e2e1974-1493-4aa4-b537-5c5c7cf7bb8f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:45.938964 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8e2e1974-1493-4aa4-b537-5c5c7cf7bb8f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:48:45.946600 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8e2e1974-1493-4aa4-b537-5c5c7cf7bb8f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 200 len: 1311 microversion: 2.1 time: 0.091399 May 11 07:48:45.947247 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 442/880] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:45 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:48:46.963528 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-07533e68-4ceb-4f57-b519-37938e6bd3a0 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:46.964143 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-07533e68-4ceb-4f57-b519-37938e6bd3a0 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:46.970617 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-07533e68-4ceb-4f57-b519-37938e6bd3a0 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:46.971065 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-07533e68-4ceb-4f57-b519-37938e6bd3a0 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:46.971853 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-07533e68-4ceb-4f57-b519-37938e6bd3a0 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:46.972793 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-07533e68-4ceb-4f57-b519-37938e6bd3a0 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:47.102388 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-07533e68-4ceb-4f57-b519-37938e6bd3a0 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:48:47.111243 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-07533e68-4ceb-4f57-b519-37938e6bd3a0 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 200 len: 1366 microversion: 2.1 time: 0.150298 May 11 07:48:47.121191 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 439/881] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:46 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:48:47.491818 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-070d3d79-e053-42a4-99ea-0b1e47274ca8 req-3802afa1-0b6c-461b-9802-4c1d2b8480b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3f77950-8d09-44e1-bf2a-1ce588a75249", "tag": "313b8090-a66c-4941-bd64-a0b505799858"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:48:47.507822 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-070d3d79-e053-42a4-99ea-0b1e47274ca8 req-3802afa1-0b6c-461b-9802-4c1d2b8480b8 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:47.508394 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-070d3d79-e053-42a4-99ea-0b1e47274ca8 req-3802afa1-0b6c-461b-9802-4c1d2b8480b8 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:47.521148 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-070d3d79-e053-42a4-99ea-0b1e47274ca8 req-3802afa1-0b6c-461b-9802-4c1d2b8480b8 service nova] Creating event network-changed:313b8090-a66c-4941-bd64-a0b505799858 for instance d3f77950-8d09-44e1-bf2a-1ce588a75249 on hv-cinder-83699 May 11 07:48:47.526319 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-070d3d79-e053-42a4-99ea-0b1e47274ca8 req-3802afa1-0b6c-461b-9802-4c1d2b8480b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045494 May 11 07:48:47.527462 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 443/882] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:48:48.128267 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a196cf9d-67b9-44e5-8426-6b198224d98e tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:48.129406 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a196cf9d-67b9-44e5-8426-6b198224d98e tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:48.135811 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a196cf9d-67b9-44e5-8426-6b198224d98e tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:48.136252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a196cf9d-67b9-44e5-8426-6b198224d98e tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:48.137005 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a196cf9d-67b9-44e5-8426-6b198224d98e tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:48.137429 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a196cf9d-67b9-44e5-8426-6b198224d98e tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:48.268645 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-a196cf9d-67b9-44e5-8426-6b198224d98e tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:48:48.276008 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a196cf9d-67b9-44e5-8426-6b198224d98e tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 200 len: 1366 microversion: 2.1 time: 0.151663 May 11 07:48:48.276558 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 440/883] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:48 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:48:49.293192 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e88312cc-c061-45b2-8658-009a6187d594 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:49.293930 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e88312cc-c061-45b2-8658-009a6187d594 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:49.300696 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e88312cc-c061-45b2-8658-009a6187d594 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:49.301456 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e88312cc-c061-45b2-8658-009a6187d594 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:49.302268 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e88312cc-c061-45b2-8658-009a6187d594 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:49.302713 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e88312cc-c061-45b2-8658-009a6187d594 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:49.435565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e88312cc-c061-45b2-8658-009a6187d594 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:48:49.443540 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e88312cc-c061-45b2-8658-009a6187d594 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 200 len: 1366 microversion: 2.1 time: 0.155019 May 11 07:48:49.444099 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 444/884] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:49 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:48:50.460527 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-229650e0-a8dc-4d0e-afec-0eefcbc4e7b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:50.461142 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-229650e0-a8dc-4d0e-afec-0eefcbc4e7b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:50.467462 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-229650e0-a8dc-4d0e-afec-0eefcbc4e7b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:50.467915 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-229650e0-a8dc-4d0e-afec-0eefcbc4e7b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:50.468679 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-229650e0-a8dc-4d0e-afec-0eefcbc4e7b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:50.469118 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-229650e0-a8dc-4d0e-afec-0eefcbc4e7b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:50.747905 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-229650e0-a8dc-4d0e-afec-0eefcbc4e7b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:48:50.755473 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-229650e0-a8dc-4d0e-afec-0eefcbc4e7b3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 200 len: 1366 microversion: 2.1 time: 0.299248 May 11 07:48:50.756025 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 441/885] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:50 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:48:51.682668 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-5cb8c382-3388-4222-8a86-d8f34ab78eaf req-bbf966e1-7876-4ad6-a104-01bce722ddeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3f77950-8d09-44e1-bf2a-1ce588a75249", "name": "network-vif-plugged", "status": "completed", "tag": "313b8090-a66c-4941-bd64-a0b505799858"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:48:51.691992 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-5cb8c382-3388-4222-8a86-d8f34ab78eaf req-bbf966e1-7876-4ad6-a104-01bce722ddeb service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:51.692439 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-5cb8c382-3388-4222-8a86-d8f34ab78eaf req-bbf966e1-7876-4ad6-a104-01bce722ddeb service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:51.703432 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-5cb8c382-3388-4222-8a86-d8f34ab78eaf req-bbf966e1-7876-4ad6-a104-01bce722ddeb service nova] Creating event network-vif-plugged:313b8090-a66c-4941-bd64-a0b505799858 for instance d3f77950-8d09-44e1-bf2a-1ce588a75249 on hv-cinder-83699 May 11 07:48:51.708246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-5cb8c382-3388-4222-8a86-d8f34ab78eaf req-bbf966e1-7876-4ad6-a104-01bce722ddeb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029186 May 11 07:48:51.708822 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 445/886] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:48:51.772091 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-bbed7bab-36f5-4d39-80d3-a446a99c3a7a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:51.773247 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-bbed7bab-36f5-4d39-80d3-a446a99c3a7a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:51.779245 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bbed7bab-36f5-4d39-80d3-a446a99c3a7a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:51.779892 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bbed7bab-36f5-4d39-80d3-a446a99c3a7a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:51.780845 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bbed7bab-36f5-4d39-80d3-a446a99c3a7a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:51.781283 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bbed7bab-36f5-4d39-80d3-a446a99c3a7a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:51.911873 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-bbed7bab-36f5-4d39-80d3-a446a99c3a7a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:48:51.919074 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-bbed7bab-36f5-4d39-80d3-a446a99c3a7a tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 200 len: 1366 microversion: 2.1 time: 0.150920 May 11 07:48:51.919829 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 442/887] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:51 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:48:52.936738 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3a809d4e-f3c6-4d30-9d4c-40cfc51a41c5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:52.937434 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3a809d4e-f3c6-4d30-9d4c-40cfc51a41c5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:52.943812 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3a809d4e-f3c6-4d30-9d4c-40cfc51a41c5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:52.944261 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3a809d4e-f3c6-4d30-9d4c-40cfc51a41c5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:52.945028 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3a809d4e-f3c6-4d30-9d4c-40cfc51a41c5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:52.945466 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3a809d4e-f3c6-4d30-9d4c-40cfc51a41c5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:53.070544 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3a809d4e-f3c6-4d30-9d4c-40cfc51a41c5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:48:53.077687 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3a809d4e-f3c6-4d30-9d4c-40cfc51a41c5 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 200 len: 1366 microversion: 2.1 time: 0.145618 May 11 07:48:53.078242 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 446/888] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:52 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:48:54.094461 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-fd017307-9e66-4b90-a34d-b400d6b0b36f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:54.095044 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-fd017307-9e66-4b90-a34d-b400d6b0b36f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:54.101237 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd017307-9e66-4b90-a34d-b400d6b0b36f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:54.101718 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd017307-9e66-4b90-a34d-b400d6b0b36f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:54.102474 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd017307-9e66-4b90-a34d-b400d6b0b36f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:54.102913 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd017307-9e66-4b90-a34d-b400d6b0b36f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:54.229058 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-fd017307-9e66-4b90-a34d-b400d6b0b36f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:48:54.236229 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-fd017307-9e66-4b90-a34d-b400d6b0b36f tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 200 len: 1556 microversion: 2.1 time: 0.145627 May 11 07:48:54.236779 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 443/889] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:48:54 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 1556 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:48:54.252652 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-66c78a72-5c90-40aa-932d-d24a025dd7f2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:48:54.253128 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-66c78a72-5c90-40aa-932d-d24a025dd7f2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:48:54.259944 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-66c78a72-5c90-40aa-932d-d24a025dd7f2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:54.260393 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-66c78a72-5c90-40aa-932d-d24a025dd7f2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:54.261147 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-66c78a72-5c90-40aa-932d-d24a025dd7f2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:54.261613 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-66c78a72-5c90-40aa-932d-d24a025dd7f2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:54.337792 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-66c78a72-5c90-40aa-932d-d24a025dd7f2 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088884 May 11 07:48:54.338375 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 447/890] 10.222.0.36 () {58 vars in 1274 bytes} [Wed May 11 07:48:54 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:48:55.343088 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-9f9002be-f1c8-4390-b0fe-7a44554805e2 req-fe9d2e1c-1c9e-4b13-896a-a5b27fcba26d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3f77950-8d09-44e1-bf2a-1ce588a75249", "tag": "313b8090-a66c-4941-bd64-a0b505799858"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:48:55.351366 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-9f9002be-f1c8-4390-b0fe-7a44554805e2 req-fe9d2e1c-1c9e-4b13-896a-a5b27fcba26d service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:48:55.351807 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-9f9002be-f1c8-4390-b0fe-7a44554805e2 req-fe9d2e1c-1c9e-4b13-896a-a5b27fcba26d service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:48:55.362349 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-9f9002be-f1c8-4390-b0fe-7a44554805e2 req-fe9d2e1c-1c9e-4b13-896a-a5b27fcba26d service nova] Creating event network-changed:313b8090-a66c-4941-bd64-a0b505799858 for instance d3f77950-8d09-44e1-bf2a-1ce588a75249 on hv-cinder-83699 May 11 07:48:55.367986 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-9f9002be-f1c8-4390-b0fe-7a44554805e2 req-fe9d2e1c-1c9e-4b13-896a-a5b27fcba26d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085994 May 11 07:48:55.368540 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 444/891] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:49:31.234566 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-73c335ef-669f-4b0c-8421-5f391d0786e3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:31.235185 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-73c335ef-669f-4b0c-8421-5f391d0786e3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:31.241694 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-73c335ef-669f-4b0c-8421-5f391d0786e3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:31.242148 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-73c335ef-669f-4b0c-8421-5f391d0786e3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:31.242903 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-73c335ef-669f-4b0c-8421-5f391d0786e3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:31.243343 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-73c335ef-669f-4b0c-8421-5f391d0786e3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:31.265465 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-73c335ef-669f-4b0c-8421-5f391d0786e3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249/ips" status: 200 len: 149 microversion: 2.1 time: 0.035279 May 11 07:49:31.266041 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 448/892] 10.222.0.36 () {58 vars in 1247 bytes} [Wed May 11 07:49:31 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:49:32.572556 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2c277297-ec0e-4d3c-b4fe-5a084e5d7a47 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04ae676e-9b40-499e-b693-6bb38d917516"}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:49:32.573726 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2c277297-ec0e-4d3c-b4fe-5a084e5d7a47 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:32.579735 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c277297-ec0e-4d3c-b4fe-5a084e5d7a47 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:32.580179 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c277297-ec0e-4d3c-b4fe-5a084e5d7a47 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:32.581406 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c277297-ec0e-4d3c-b4fe-5a084e5d7a47 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:32.581871 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c277297-ec0e-4d3c-b4fe-5a084e5d7a47 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:32.807308 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2c277297-ec0e-4d3c-b4fe-5a084e5d7a47 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "POST /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.238968 May 11 07:49:32.807947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 445/893] 10.222.0.36 () {60 vars in 1322 bytes} [Wed May 11 07:49:32 2022] POST /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:49:39.308612 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f02f5660-80bc-415b-8043-a6d2a01db37d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:39.309094 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-f02f5660-80bc-415b-8043-a6d2a01db37d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:39.315553 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f02f5660-80bc-415b-8043-a6d2a01db37d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:39.315999 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f02f5660-80bc-415b-8043-a6d2a01db37d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:39.316754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f02f5660-80bc-415b-8043-a6d2a01db37d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:39.317446 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-f02f5660-80bc-415b-8043-a6d2a01db37d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:39.392603 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.objects.instance [None req-f02f5660-80bc-415b-8043-a6d2a01db37d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lazy-loading 'services' on Instance uuid d3f77950-8d09-44e1-bf2a-1ce588a75249 {{(pid=123600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:49:39.461434 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f02f5660-80bc-415b-8043-a6d2a01db37d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249/os-volume_attachments/04ae676e-9b40-499e-b693-6bb38d917516" status: 202 len: 0 microversion: 2.1 time: 0.156646 May 11 07:49:39.462049 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 449/894] 10.222.0.36 () {58 vars in 1415 bytes} [Wed May 11 07:49:39 2022] DELETE /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249/os-volume_attachments/04ae676e-9b40-499e-b693-6bb38d917516 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:49:39.471348 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-a1f78faf-5c38-4cdd-ab82-c8eb885aa0ea tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:39.472350 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-a1f78faf-5c38-4cdd-ab82-c8eb885aa0ea tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:39.478648 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a1f78faf-5c38-4cdd-ab82-c8eb885aa0ea tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:39.479101 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a1f78faf-5c38-4cdd-ab82-c8eb885aa0ea tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:39.479879 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a1f78faf-5c38-4cdd-ab82-c8eb885aa0ea tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:39.480317 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-a1f78faf-5c38-4cdd-ab82-c8eb885aa0ea tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:39.512240 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-a1f78faf-5c38-4cdd-ab82-c8eb885aa0ea tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045574 May 11 07:49:39.512903 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 446/895] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:49:39 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:49:40.525741 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9a94f4dc-35b4-4ed5-b538-d307167bf776 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:40.526731 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9a94f4dc-35b4-4ed5-b538-d307167bf776 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:40.533396 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9a94f4dc-35b4-4ed5-b538-d307167bf776 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:40.533967 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9a94f4dc-35b4-4ed5-b538-d307167bf776 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:40.535337 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9a94f4dc-35b4-4ed5-b538-d307167bf776 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:40.535777 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9a94f4dc-35b4-4ed5-b538-d307167bf776 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:40.564903 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9a94f4dc-35b4-4ed5-b538-d307167bf776 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043884 May 11 07:49:40.565444 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 450/896] 10.222.0.36 () {58 vars in 1301 bytes} [Wed May 11 07:49:40 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 07:49:40.620477 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-d4776b20-6dea-4fc0-93d7-b71c219213e4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:40.620967 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d4776b20-6dea-4fc0-93d7-b71c219213e4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:40.627137 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4776b20-6dea-4fc0-93d7-b71c219213e4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:40.627584 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4776b20-6dea-4fc0-93d7-b71c219213e4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:40.628517 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4776b20-6dea-4fc0-93d7-b71c219213e4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:40.628952 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-d4776b20-6dea-4fc0-93d7-b71c219213e4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:40.654591 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-d4776b20-6dea-4fc0-93d7-b71c219213e4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Going to try to terminate instance {{(pid=123599) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:49:40.726483 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-d4776b20-6dea-4fc0-93d7-b71c219213e4 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 204 len: 0 microversion: 2.1 time: 0.109505 May 11 07:49:40.728842 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 447/897] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:49:40 2022] DELETE /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:49:40.735925 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-cbac45a8-2af9-4bd4-a675-d589cafc73eb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:40.736571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-cbac45a8-2af9-4bd4-a675-d589cafc73eb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:40.742429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cbac45a8-2af9-4bd4-a675-d589cafc73eb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:40.742878 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cbac45a8-2af9-4bd4-a675-d589cafc73eb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:40.743640 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cbac45a8-2af9-4bd4-a675-d589cafc73eb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:40.744072 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-cbac45a8-2af9-4bd4-a675-d589cafc73eb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:40.867929 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-cbac45a8-2af9-4bd4-a675-d589cafc73eb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:49:40.875142 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-cbac45a8-2af9-4bd4-a675-d589cafc73eb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 200 len: 1680 microversion: 2.1 time: 0.143635 May 11 07:49:40.875701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 451/898] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:49:40 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 1680 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:49:41.893319 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-58fd405f-0bff-4836-8b40-209cec5acde3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:41.893958 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-58fd405f-0bff-4836-8b40-209cec5acde3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:41.900254 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-58fd405f-0bff-4836-8b40-209cec5acde3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:41.900705 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-58fd405f-0bff-4836-8b40-209cec5acde3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:41.901470 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-58fd405f-0bff-4836-8b40-209cec5acde3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:41.901934 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-58fd405f-0bff-4836-8b40-209cec5acde3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:42.033702 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-58fd405f-0bff-4836-8b40-209cec5acde3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:49:42.041482 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-58fd405f-0bff-4836-8b40-209cec5acde3 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 200 len: 1680 microversion: 2.1 time: 0.152440 May 11 07:49:42.042056 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 448/899] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:49:41 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:49:43.058969 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2045a649-3c5b-4388-9bed-6b68d50801c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:43.059654 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-2045a649-3c5b-4388-9bed-6b68d50801c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:43.065490 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2045a649-3c5b-4388-9bed-6b68d50801c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:43.066548 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2045a649-3c5b-4388-9bed-6b68d50801c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:43.067609 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2045a649-3c5b-4388-9bed-6b68d50801c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:43.068049 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-2045a649-3c5b-4388-9bed-6b68d50801c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:43.195522 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-2045a649-3c5b-4388-9bed-6b68d50801c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb737cfd514343dfbfbc30816cf5f655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbefc9c91dab46baa2707f01c83e48e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:49:43.203562 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2045a649-3c5b-4388-9bed-6b68d50801c8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 200 len: 1680 microversion: 2.1 time: 0.148721 May 11 07:49:43.204142 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 452/900] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:49:43 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:49:43.522258 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-0e3576a0-8d81-408d-8971-5574f9622970 req-ddcb13b5-29f5-49b8-b684-41ebb59c3fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3f77950-8d09-44e1-bf2a-1ce588a75249", "name": "network-vif-deleted", "tag": "313b8090-a66c-4941-bd64-a0b505799858"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:49:43.530865 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-0e3576a0-8d81-408d-8971-5574f9622970 req-ddcb13b5-29f5-49b8-b684-41ebb59c3fe1 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:43.531328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-0e3576a0-8d81-408d-8971-5574f9622970 req-ddcb13b5-29f5-49b8-b684-41ebb59c3fe1 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:43.542922 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-0e3576a0-8d81-408d-8971-5574f9622970 req-ddcb13b5-29f5-49b8-b684-41ebb59c3fe1 service nova] Creating event network-vif-deleted:313b8090-a66c-4941-bd64-a0b505799858 for instance d3f77950-8d09-44e1-bf2a-1ce588a75249 on hv-cinder-83699 May 11 07:49:43.547956 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-0e3576a0-8d81-408d-8971-5574f9622970 req-ddcb13b5-29f5-49b8-b684-41ebb59c3fe1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030061 May 11 07:49:43.548552 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 449/901] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:49:44.220349 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c8084ac4-9662-43e1-8708-b88f183fbfb8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:44.220914 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c8084ac4-9662-43e1-8708-b88f183fbfb8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:44.227247 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c8084ac4-9662-43e1-8708-b88f183fbfb8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:44.227700 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c8084ac4-9662-43e1-8708-b88f183fbfb8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:44.228468 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c8084ac4-9662-43e1-8708-b88f183fbfb8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:44.228908 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c8084ac4-9662-43e1-8708-b88f183fbfb8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:44.242164 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-c8084ac4-9662-43e1-8708-b88f183fbfb8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] HTTP exception thrown: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c8084ac4-9662-43e1-8708-b88f183fbfb8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Request method failure captured: May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 HTTP/1.1 May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2mEHqQL-u3ouRY26Qw00htshbb-Yff6Ho3PvS4ty6HQr0GnvWuxtj6K5fRiT6sYE4t3AbTSvAlw3oMBLjIhYarCsmhj2jk7lLeHkyPOY-QXvOFSOdAVZ-fXXXrmiCClFSyTB3XsO_5HsLGbCQ8V4LKdnzODb28mc4LszNG8l56As9U May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:49:44.243819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:49:44.245442 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbefc9c91dab46baa2707f01c83e48e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}] May 11 07:49:44.245442 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:44.245442 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:44.245442 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:44.245442 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:44.245442 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:49:44.245442 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:49:44.245442 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: cb737cfd514343dfbfbc30816cf5f655 May 11 07:49:44.245442 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:44.245442 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:49:44.245442 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:44.245442 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': 'd3f77950-8d09-44e1-bf2a-1ce588a75249'} May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:44.246312 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:44.247643 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:44.249465 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c8084ac4-9662-43e1-8708-b88f183fbfb8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Returning 404 to user: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:44.249465 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c8084ac4-9662-43e1-8708-b88f183fbfb8 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 404 len: 111 microversion: 2.1 time: 0.028826 May 11 07:49:44.249465 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 453/902] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:49:44 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:49:44.255786 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6dae8d5f-13d6-48a9-8142-0adb25aca891 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '.version_select at 0x7f19ec8e28b0>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:44.274918 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-6dae8d5f-13d6-48a9-8142-0adb25aca891 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577577951" status: 202 len: 0 microversion: 2.1 time: 0.023730 May 11 07:49:44.275535 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 450/903] 10.222.0.36 () {58 vars in 1220 bytes} [Wed May 11 07:49:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577577951 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:49:46.014300 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b03465af-674e-45ce-ab4a-16b0d40e22bb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:46.014821 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-b03465af-674e-45ce-ab4a-16b0d40e22bb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:46.021495 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b03465af-674e-45ce-ab4a-16b0d40e22bb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:46.021974 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b03465af-674e-45ce-ab4a-16b0d40e22bb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:46.022730 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b03465af-674e-45ce-ab4a-16b0d40e22bb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:46.023164 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-b03465af-674e-45ce-ab4a-16b0d40e22bb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:46.037953 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-b03465af-674e-45ce-ab4a-16b0d40e22bb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] HTTP exception thrown: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b03465af-674e-45ce-ab4a-16b0d40e22bb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Request method failure captured: May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: DELETE /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 HTTP/1.1 May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2mEHqQL-u3ouRY26Qw00htshbb-Yff6Ho3PvS4ty6HQr0GnvWuxtj6K5fRiT6sYE4t3AbTSvAlw3oMBLjIhYarCsmhj2jk7lLeHkyPOY-QXvOFSOdAVZ-fXXXrmiCClFSyTB3XsO_5HsLGbCQ8V4LKdnzODb28mc4LszNG8l56As9U May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:49:46.039413 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:49:46.041109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbefc9c91dab46baa2707f01c83e48e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}] May 11 07:49:46.041109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:46.041109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:46.041109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:46.041109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:46.041109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:49:46.041109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:49:46.041109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: cb737cfd514343dfbfbc30816cf5f655 May 11 07:49:46.041109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:46.041109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:49:46.041109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:46.041109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': 'd3f77950-8d09-44e1-bf2a-1ce588a75249'} May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:46.044701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:46.046232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:46.047715 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-b03465af-674e-45ce-ab4a-16b0d40e22bb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Returning 404 to user: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:46.047715 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-b03465af-674e-45ce-ab4a-16b0d40e22bb tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 404 len: 111 microversion: 2.1 time: 0.030276 May 11 07:49:46.047715 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 454/904] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:49:46 2022] DELETE /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 07:49:46.049563 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-da976695-d1d7-44a5-8644-ce2ab0a0e13d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:46.050349 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-da976695-d1d7-44a5-8644-ce2ab0a0e13d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: d3f77950-8d09-44e1-bf2a-1ce588a75249] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:46.056323 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-da976695-d1d7-44a5-8644-ce2ab0a0e13d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:46.056764 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-da976695-d1d7-44a5-8644-ce2ab0a0e13d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:46.057513 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-da976695-d1d7-44a5-8644-ce2ab0a0e13d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:46.057967 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-da976695-d1d7-44a5-8644-ce2ab0a0e13d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:46.071014 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-da976695-d1d7-44a5-8644-ce2ab0a0e13d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] HTTP exception thrown: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-da976695-d1d7-44a5-8644-ce2ab0a0e13d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Request method failure captured: May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 HTTP/1.1 May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2mEHqQL-u3ouRY26Qw00htshbb-Yff6Ho3PvS4ty6HQr0GnvWuxtj6K5fRiT6sYE4t3AbTSvAlw3oMBLjIhYarCsmhj2jk7lLeHkyPOY-QXvOFSOdAVZ-fXXXrmiCClFSyTB3XsO_5HsLGbCQ8V4LKdnzODb28mc4LszNG8l56As9U May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:49:46.072599 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:49:46.074156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbefc9c91dab46baa2707f01c83e48e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}] May 11 07:49:46.074156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:46.074156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:46.074156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:46.074156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:46.074156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:49:46.074156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:49:46.074156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: cb737cfd514343dfbfbc30816cf5f655 May 11 07:49:46.074156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:46.074156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:49:46.074156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:46.074156 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': 'd3f77950-8d09-44e1-bf2a-1ce588a75249'} May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:46.075181 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. May 11 07:49:46.076596 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:46.077936 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-da976695-d1d7-44a5-8644-ce2ab0a0e13d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Returning 404 to user: Instance d3f77950-8d09-44e1-bf2a-1ce588a75249 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:46.077936 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-da976695-d1d7-44a5-8644-ce2ab0a0e13d tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249" status: 404 len: 111 microversion: 2.1 time: 0.028692 May 11 07:49:46.077936 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 451/905] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:49:46 2022] GET /compute/v2.1/servers/d3f77950-8d09-44e1-bf2a-1ce588a75249 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:49:47.202540 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1dd78eb1-b2c5-4dff-a5f8-abc8af9e1f43 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:47.203026 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-1dd78eb1-b2c5-4dff-a5f8-abc8af9e1f43 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:47.209509 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1dd78eb1-b2c5-4dff-a5f8-abc8af9e1f43 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:47.209993 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1dd78eb1-b2c5-4dff-a5f8-abc8af9e1f43 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:47.210760 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1dd78eb1-b2c5-4dff-a5f8-abc8af9e1f43 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:47.211223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-1dd78eb1-b2c5-4dff-a5f8-abc8af9e1f43 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:47.224924 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-1dd78eb1-b2c5-4dff-a5f8-abc8af9e1f43 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] HTTP exception thrown: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1dd78eb1-b2c5-4dff-a5f8-abc8af9e1f43 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Request method failure captured: May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: DELETE /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 HTTP/1.1 May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2mEHqQL-u3ouRY26Qw00htshbb-Yff6Ho3PvS4ty6HQr0GnvWuxtj6K5fRiT6sYE4t3AbTSvAlw3oMBLjIhYarCsmhj2jk7lLeHkyPOY-QXvOFSOdAVZ-fXXXrmiCClFSyTB3XsO_5HsLGbCQ8V4LKdnzODb28mc4LszNG8l56As9U May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:49:47.226487 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:49:47.228029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbefc9c91dab46baa2707f01c83e48e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}] May 11 07:49:47.228029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:47.228029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:47.228029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:47.228029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:47.228029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:49:47.228029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:49:47.228029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: cb737cfd514343dfbfbc30816cf5f655 May 11 07:49:47.228029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:47.228029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:49:47.228029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:49:47.228029 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '61fe52bc-415c-4beb-8a2c-0098912a19b7'} May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:47.228916 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:49:47.230378 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:47.231887 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-1dd78eb1-b2c5-4dff-a5f8-abc8af9e1f43 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Returning 404 to user: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:47.231887 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-1dd78eb1-b2c5-4dff-a5f8-abc8af9e1f43 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 404 len: 111 microversion: 2.1 time: 0.029181 May 11 07:49:47.231887 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 455/906] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:49:47 2022] DELETE /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:49:47.236207 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-f270345a-1e79-4d52-ae8c-1263ea9f1fe1 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:47.236821 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-f270345a-1e79-4d52-ae8c-1263ea9f1fe1 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 61fe52bc-415c-4beb-8a2c-0098912a19b7] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:47.243801 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f270345a-1e79-4d52-ae8c-1263ea9f1fe1 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:47.244252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f270345a-1e79-4d52-ae8c-1263ea9f1fe1 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:47.245013 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f270345a-1e79-4d52-ae8c-1263ea9f1fe1 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:47.245450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-f270345a-1e79-4d52-ae8c-1263ea9f1fe1 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:47.258457 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-f270345a-1e79-4d52-ae8c-1263ea9f1fe1 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] HTTP exception thrown: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-f270345a-1e79-4d52-ae8c-1263ea9f1fe1 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Request method failure captured: May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 HTTP/1.1 May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2mEHqQL-u3ouRY26Qw00htshbb-Yff6Ho3PvS4ty6HQr0GnvWuxtj6K5fRiT6sYE4t3AbTSvAlw3oMBLjIhYarCsmhj2jk7lLeHkyPOY-QXvOFSOdAVZ-fXXXrmiCClFSyTB3XsO_5HsLGbCQ8V4LKdnzODb28mc4LszNG8l56As9U May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:49:47.259954 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:49:47.261478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbefc9c91dab46baa2707f01c83e48e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}] May 11 07:49:47.261478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:47.261478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:47.261478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:47.261478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:47.261478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:49:47.261478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:49:47.261478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: cb737cfd514343dfbfbc30816cf5f655 May 11 07:49:47.261478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:47.261478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:49:47.261478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:49:47.261478 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '61fe52bc-415c-4beb-8a2c-0098912a19b7'} May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:47.262445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. May 11 07:49:47.263930 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:47.265405 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-f270345a-1e79-4d52-ae8c-1263ea9f1fe1 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Returning 404 to user: Instance 61fe52bc-415c-4beb-8a2c-0098912a19b7 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:47.265405 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-f270345a-1e79-4d52-ae8c-1263ea9f1fe1 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7" status: 404 len: 111 microversion: 2.1 time: 0.028917 May 11 07:49:47.265405 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 452/907] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:49:47 2022] GET /compute/v2.1/servers/61fe52bc-415c-4beb-8a2c-0098912a19b7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:49:47.270086 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5dc02b2d-9acc-423c-be78-a736967977a9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:47.270617 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-5dc02b2d-9acc-423c-be78-a736967977a9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:47.276406 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5dc02b2d-9acc-423c-be78-a736967977a9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:47.276861 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5dc02b2d-9acc-423c-be78-a736967977a9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:47.277670 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5dc02b2d-9acc-423c-be78-a736967977a9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:47.278114 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5dc02b2d-9acc-423c-be78-a736967977a9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:47.291844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-5dc02b2d-9acc-423c-be78-a736967977a9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] HTTP exception thrown: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5dc02b2d-9acc-423c-be78-a736967977a9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Request method failure captured: May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: DELETE /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 HTTP/1.1 May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2mEHqQL-u3ouRY26Qw00htshbb-Yff6Ho3PvS4ty6HQr0GnvWuxtj6K5fRiT6sYE4t3AbTSvAlw3oMBLjIhYarCsmhj2jk7lLeHkyPOY-QXvOFSOdAVZ-fXXXrmiCClFSyTB3XsO_5HsLGbCQ8V4LKdnzODb28mc4LszNG8l56As9U May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:49:47.293366 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:49:47.294932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbefc9c91dab46baa2707f01c83e48e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}] May 11 07:49:47.294932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:47.294932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:47.294932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:47.294932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:47.294932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:49:47.294932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:49:47.294932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: cb737cfd514343dfbfbc30816cf5f655 May 11 07:49:47.294932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:47.294932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:49:47.294932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:49:47.294932 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': 'eb54010c-43ca-4040-8312-da1d47697fa0'} May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:47.295813 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:49:47.297223 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:47.298818 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5dc02b2d-9acc-423c-be78-a736967977a9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Returning 404 to user: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:47.298818 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-5dc02b2d-9acc-423c-be78-a736967977a9 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 404 len: 111 microversion: 2.1 time: 0.029053 May 11 07:49:47.298818 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 456/908] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:49:47 2022] DELETE /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 07:49:47.302896 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7ba7f6ef-55d1-40d5-b4f0-509aad515676 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:47.303504 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-7ba7f6ef-55d1-40d5-b4f0-509aad515676 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: eb54010c-43ca-4040-8312-da1d47697fa0] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:47.309394 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7ba7f6ef-55d1-40d5-b4f0-509aad515676 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:47.309891 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7ba7f6ef-55d1-40d5-b4f0-509aad515676 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:47.310652 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7ba7f6ef-55d1-40d5-b4f0-509aad515676 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:47.311083 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7ba7f6ef-55d1-40d5-b4f0-509aad515676 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:47.324082 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-7ba7f6ef-55d1-40d5-b4f0-509aad515676 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] HTTP exception thrown: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7ba7f6ef-55d1-40d5-b4f0-509aad515676 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Request method failure captured: May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 HTTP/1.1 May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2mEHqQL-u3ouRY26Qw00htshbb-Yff6Ho3PvS4ty6HQr0GnvWuxtj6K5fRiT6sYE4t3AbTSvAlw3oMBLjIhYarCsmhj2jk7lLeHkyPOY-QXvOFSOdAVZ-fXXXrmiCClFSyTB3XsO_5HsLGbCQ8V4LKdnzODb28mc4LszNG8l56As9U May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:49:47.325626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:49:47.327252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbefc9c91dab46baa2707f01c83e48e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}] May 11 07:49:47.327252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:47.327252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:47.327252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:47.327252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:47.327252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:49:47.327252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:49:47.327252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: cb737cfd514343dfbfbc30816cf5f655 May 11 07:49:47.327252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:47.327252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:49:47.327252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:49:47.327252 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': 'eb54010c-43ca-4040-8312-da1d47697fa0'} May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:47.328250 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. May 11 07:49:47.329738 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:47.331170 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7ba7f6ef-55d1-40d5-b4f0-509aad515676 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Returning 404 to user: Instance eb54010c-43ca-4040-8312-da1d47697fa0 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:47.331170 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-7ba7f6ef-55d1-40d5-b4f0-509aad515676 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0" status: 404 len: 111 microversion: 2.1 time: 0.027782 May 11 07:49:47.331170 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 453/909] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:49:47 2022] GET /compute/v2.1/servers/eb54010c-43ca-4040-8312-da1d47697fa0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:49:48.454409 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ef72ceb5-156c-4387-9ad0-924a726a2d50 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:48.454897 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-ef72ceb5-156c-4387-9ad0-924a726a2d50 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:48.461121 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ef72ceb5-156c-4387-9ad0-924a726a2d50 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:48.461589 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ef72ceb5-156c-4387-9ad0-924a726a2d50 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:48.462347 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ef72ceb5-156c-4387-9ad0-924a726a2d50 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:48.462783 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ef72ceb5-156c-4387-9ad0-924a726a2d50 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:48.476267 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-ef72ceb5-156c-4387-9ad0-924a726a2d50 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] HTTP exception thrown: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ef72ceb5-156c-4387-9ad0-924a726a2d50 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Request method failure captured: May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: DELETE /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 HTTP/1.1 May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2mEHqQL-u3ouRY26Qw00htshbb-Yff6Ho3PvS4ty6HQr0GnvWuxtj6K5fRiT6sYE4t3AbTSvAlw3oMBLjIhYarCsmhj2jk7lLeHkyPOY-QXvOFSOdAVZ-fXXXrmiCClFSyTB3XsO_5HsLGbCQ8V4LKdnzODb28mc4LszNG8l56As9U May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:49:48.477824 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:49:48.479352 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbefc9c91dab46baa2707f01c83e48e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}] May 11 07:49:48.479352 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:48.479352 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:48.479352 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:48.479352 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:48.479352 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:49:48.479352 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:49:48.479352 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: cb737cfd514343dfbfbc30816cf5f655 May 11 07:49:48.479352 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:48.479352 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: > May 11 07:49:48.479352 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:49:48.479352 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '2c09ecce-a2f8-499a-81fc-b35151fdd6b4'} May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:48.480252 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:49:48.481735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:48.483265 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ef72ceb5-156c-4387-9ad0-924a726a2d50 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Returning 404 to user: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:48.483265 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-ef72ceb5-156c-4387-9ad0-924a726a2d50 tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 404 len: 111 microversion: 2.1 time: 0.028638 May 11 07:49:48.483265 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 457/910] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:49:48 2022] DELETE /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:49:48.487911 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3d07c95e-b449-40b5-88f2-0fce13d395ef tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:48.489090 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-3d07c95e-b449-40b5-88f2-0fce13d395ef tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] [instance: 2c09ecce-a2f8-499a-81fc-b35151fdd6b4] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:49:48.495392 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3d07c95e-b449-40b5-88f2-0fce13d395ef tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:48.495897 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3d07c95e-b449-40b5-88f2-0fce13d395ef tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:48.496665 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3d07c95e-b449-40b5-88f2-0fce13d395ef tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:49:48.497101 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3d07c95e-b449-40b5-88f2-0fce13d395ef tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:49:48.509957 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-3d07c95e-b449-40b5-88f2-0fce13d395ef tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] HTTP exception thrown: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3d07c95e-b449-40b5-88f2-0fce13d395ef tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Request method failure captured: May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 HTTP/1.1 May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2mEHqQL-u3ouRY26Qw00htshbb-Yff6Ho3PvS4ty6HQr0GnvWuxtj6K5fRiT6sYE4t3AbTSvAlw3oMBLjIhYarCsmhj2jk7lLeHkyPOY-QXvOFSOdAVZ-fXXXrmiCClFSyTB3XsO_5HsLGbCQ8V4LKdnzODb28mc4LszNG8l56As9U May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:49:48.511450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:49:48.512949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbefc9c91dab46baa2707f01c83e48e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbefc9c91dab46baa2707f01c83e48e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbefc9c91dab46baa2707f01c83e48e2"}]}] May 11 07:49:48.512949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:48.512949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: bbefc9c91dab46baa2707f01c83e48e2 May 11 07:49:48.512949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1229044817 May 11 07:49:48.512949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:48.512949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:49:48.512949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:49:48.512949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: cb737cfd514343dfbfbc30816cf5f655 May 11 07:49:48.512949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-AttachVolumeNegativeTest-1229044817-project May 11 07:49:48.512949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:49:48.512949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:49:48.512949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '2c09ecce-a2f8-499a-81fc-b35151fdd6b4'} May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:48.514110 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. May 11 07:49:48.515328 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:48.516531 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3d07c95e-b449-40b5-88f2-0fce13d395ef tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] Returning 404 to user: Instance 2c09ecce-a2f8-499a-81fc-b35151fdd6b4 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:48.516531 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-3d07c95e-b449-40b5-88f2-0fce13d395ef tempest-AttachVolumeNegativeTest-1229044817 tempest-AttachVolumeNegativeTest-1229044817-project] 10.222.0.36 "GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4" status: 404 len: 111 microversion: 2.1 time: 0.028724 May 11 07:49:48.516531 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 454/911] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:49:48 2022] GET /compute/v2.1/servers/2c09ecce-a2f8-499a-81fc-b35151fdd6b4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:49:52.775965 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-82093ab6-bb5b-48a7-b500-3efb4492d55b tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Action: 'create', calling method: .version_select at 0x7f19ec7bc0d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-281934944", "metadata": {"Type": "work"}}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-82093ab6-bb5b-48a7-b500-3efb4492d55b tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Request method failure captured: May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 121 May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2qgOoQFpv4S1gL-0_WJO_FUYWHstjxFAS0r2Syl6eM4AkH67TBBWpHg5pLBvtGUE4xHe1aWL5wy4q6SCgeVCaA0_6caA-xrExekvK1qI9mRzhp3smDkXqZb6IS4V-6sr7M5ELJ3WIW7bbrf9heUVjhsByuJhJytM_M061b5Ny96xes May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 2916873d987d427191912a741b2eb373 May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:49:52.798198 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:49:52.799901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2916873d987d427191912a741b2eb373", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2916873d987d427191912a741b2eb373"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2916873d987d427191912a741b2eb373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2916873d987d427191912a741b2eb373"}]}] May 11 07:49:52.799901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.799901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 2916873d987d427191912a741b2eb373 May 11 07:49:52.799901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.799901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-VolumesNegativeTest-392144809-project May 11 07:49:52.799901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:49:52.799901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:49:52.799901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: dad07833fe1d4c5a952969a5befe5cbc May 11 07:49:52.799901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-VolumesNegativeTest-392144809-project May 11 07:49:52.799901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: May 11 07:49:52.799901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-281934944", "metadata": {"Type": "work"}}} May 11 07:49:52.799901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: May 11 07:49:52.799901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-281934944', 'metadata': {'Type': 'work'}}}} May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise error May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi '#$%' May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:52.801771 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 07:49:52.804007 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 07:49:52.805383 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 07:49:52.805383 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.805383 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-82093ab6-bb5b-48a7-b500-3efb4492d55b tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:52.805383 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-82093ab6-bb5b-48a7-b500-3efb4492d55b tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131333 May 11 07:49:52.805383 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 458/912] 10.222.0.36 () {60 vars in 1155 bytes} [Wed May 11 07:49:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 07:49:52.809083 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6625dfdb-67ec-4241-ae0b-f929d477ba16 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Action: 'create', calling method: .version_select at 0x7f19ec8211f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-529014422", "metadata": {"Type": "work"}}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6625dfdb-67ec-4241-ae0b-f929d477ba16 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Request method failure captured: May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 119 May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2qgOoQFpv4S1gL-0_WJO_FUYWHstjxFAS0r2Syl6eM4AkH67TBBWpHg5pLBvtGUE4xHe1aWL5wy4q6SCgeVCaA0_6caA-xrExekvK1qI9mRzhp3smDkXqZb6IS4V-6sr7M5ELJ3WIW7bbrf9heUVjhsByuJhJytM_M061b5Ny96xes May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 2916873d987d427191912a741b2eb373 May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:49:52.812316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:49:52.813866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2916873d987d427191912a741b2eb373", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2916873d987d427191912a741b2eb373"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2916873d987d427191912a741b2eb373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2916873d987d427191912a741b2eb373"}]}] May 11 07:49:52.813866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.813866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 2916873d987d427191912a741b2eb373 May 11 07:49:52.813866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.813866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-VolumesNegativeTest-392144809-project May 11 07:49:52.813866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:49:52.813866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:49:52.813866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: dad07833fe1d4c5a952969a5befe5cbc May 11 07:49:52.813866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-VolumesNegativeTest-392144809-project May 11 07:49:52.813866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: May 11 07:49:52.813866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-529014422", "metadata": {"Type": "work"}}} May 11 07:49:52.813866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: May 11 07:49:52.813866 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-529014422', 'metadata': {'Type': 'work'}}}} May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise error May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi '0' May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:52.814832 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 07:49:52.816327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 07:49:52.817875 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 07:49:52.817875 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.817875 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-6625dfdb-67ec-4241-ae0b-f929d477ba16 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:52.817875 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-6625dfdb-67ec-4241-ae0b-f929d477ba16 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008453 May 11 07:49:52.817875 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 455/913] 10.222.0.36 () {60 vars in 1155 bytes} [Wed May 11 07:49:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 07:49:52.822651 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2ec9b04e-064d-4e86-bf7b-cc872dec7527 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Action: 'create', calling method: .version_select at 0x7f19ed2351f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2117026399", "metadata": {"Type": "work"}}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2ec9b04e-064d-4e86-bf7b-cc872dec7527 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Request method failure captured: May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 119 May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2qgOoQFpv4S1gL-0_WJO_FUYWHstjxFAS0r2Syl6eM4AkH67TBBWpHg5pLBvtGUE4xHe1aWL5wy4q6SCgeVCaA0_6caA-xrExekvK1qI9mRzhp3smDkXqZb6IS4V-6sr7M5ELJ3WIW7bbrf9heUVjhsByuJhJytM_M061b5Ny96xes May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 2916873d987d427191912a741b2eb373 May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:49:52.824984 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:49:52.826635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2916873d987d427191912a741b2eb373", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2916873d987d427191912a741b2eb373"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2916873d987d427191912a741b2eb373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2916873d987d427191912a741b2eb373"}]}] May 11 07:49:52.826635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.826635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 2916873d987d427191912a741b2eb373 May 11 07:49:52.826635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.826635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-VolumesNegativeTest-392144809-project May 11 07:49:52.826635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:49:52.826635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:49:52.826635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: dad07833fe1d4c5a952969a5befe5cbc May 11 07:49:52.826635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-VolumesNegativeTest-392144809-project May 11 07:49:52.826635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: May 11 07:49:52.826635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2117026399", "metadata": {"Type": "work"}}} May 11 07:49:52.826635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: May 11 07:49:52.826635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2117026399', 'metadata': {'Type': 'work'}}}} May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise error May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi '' May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:52.827580 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 07:49:52.829213 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 07:49:52.830508 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 07:49:52.830508 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.830508 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-2ec9b04e-064d-4e86-bf7b-cc872dec7527 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:52.830508 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-2ec9b04e-064d-4e86-bf7b-cc872dec7527 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007330 May 11 07:49:52.830508 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 459/914] 10.222.0.36 () {60 vars in 1155 bytes} [Wed May 11 07:49:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 07:49:52.837228 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-fd826459-cee7-48f0-b046-07810067d8ce tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Calling method '.version_select at 0x7f19ec8fedc0>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:52.866174 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-fd826459-cee7-48f0-b046-07810067d8ce tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] HTTP exception thrown: Volume tempest-invalid-2108556166 could not be found. May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-fd826459-cee7-48f0-b046-07810067d8ce tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Request method failure captured: May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2108556166 HTTP/1.1 May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2qgOoQFpv4S1gL-0_WJO_FUYWHstjxFAS0r2Syl6eM4AkH67TBBWpHg5pLBvtGUE4xHe1aWL5wy4q6SCgeVCaA0_6caA-xrExekvK1qI9mRzhp3smDkXqZb6IS4V-6sr7M5ELJ3WIW7bbrf9heUVjhsByuJhJytM_M061b5Ny96xes May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 2916873d987d427191912a741b2eb373 May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:49:52.868132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:49:52.869791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2916873d987d427191912a741b2eb373", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2916873d987d427191912a741b2eb373"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2916873d987d427191912a741b2eb373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2916873d987d427191912a741b2eb373"}]}] May 11 07:49:52.869791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.869791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 2916873d987d427191912a741b2eb373 May 11 07:49:52.869791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.869791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-VolumesNegativeTest-392144809-project May 11 07:49:52.869791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:49:52.869791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:49:52.869791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: dad07833fe1d4c5a952969a5befe5cbc May 11 07:49:52.869791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-VolumesNegativeTest-392144809-project May 11 07:49:52.869791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: May 11 07:49:52.869791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Volume tempest-invalid-2108556166 could not be found. May 11 07:49:52.869791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': 'tempest-invalid-2108556166'} May 11 07:49:52.869791 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2108556166 could not be found. (HTTP 404) (Request-ID: req-18ad527b-56a0-458e-8a1d-4523eba10bd0) May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.870796 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 07:49:52.872242 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2108556166 could not be found. May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:49:52.873637 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2108556166 could not be found. May 11 07:49:52.875217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.875217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.875217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.875217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.875217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:52.875217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:52.875217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:49:52.875217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:49:52.875217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2108556166 could not be found. May 11 07:49:52.875217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.875217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-fd826459-cee7-48f0-b046-07810067d8ce tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Returning 404 to user: Volume tempest-invalid-2108556166 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:52.875217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-fd826459-cee7-48f0-b046-07810067d8ce tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2108556166" status: 404 len: 99 microversion: 2.1 time: 0.036409 May 11 07:49:52.875217 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 456/915] 10.222.0.36 () {58 vars in 1217 bytes} [Wed May 11 07:49:52 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2108556166 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 11 07:49:52.879596 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-cd7cb6a9-c405-48ad-b347-bbb196e7b120 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004232 May 11 07:49:52.880081 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 460/916] 10.222.0.36 () {58 vars in 1139 bytes} [Wed May 11 07:49:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 11 07:49:52.888237 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-0ff3f05b-ed26-4f9f-b11d-cb0dcf482ed2 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003595 May 11 07:49:52.888719 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 457/917] 10.222.0.36 () {58 vars in 1136 bytes} [Wed May 11 07:49:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 11 07:49:52.897109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e111ffab-82eb-48a2-84a5-2e33e0c6d2f0 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Calling method '.version_select at 0x7f19ec7bcf70>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:52.924149 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.wsgi [None req-e111ffab-82eb-48a2-84a5-2e33e0c6d2f0 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] HTTP exception thrown: Volume 6b49a7f2-d2c2-44da-9e73-deccf207e27e could not be found. May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e111ffab-82eb-48a2-84a5-2e33e0c6d2f0 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Request method failure captured: May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: request: DELETE /compute/v2.1/os-volumes/6b49a7f2-d2c2-44da-9e73-deccf207e27e HTTP/1.1 May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept: application/json May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Accept-Encoding: identity May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Connection: close May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Length: 0 May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Content-Type: application/json May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Host: 10.222.0.36 May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Openstack-System-Scope: None May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: User-Agent: python-urllib3/1.26.9 May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Auth-Token: gAAAAABie2qgOoQFpv4S1gL-0_WJO_FUYWHstjxFAS0r2Syl6eM4AkH67TBBWpHg5pLBvtGUE4xHe1aWL5wy4q6SCgeVCaA0_6caA-xrExekvK1qI9mRzhp3smDkXqZb6IS4V-6sr7M5ELJ3WIW7bbrf9heUVjhsByuJhJytM_M061b5Ny96xes May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Id: None May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Domain-Name: None May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Identity-Status: Confirmed May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Is-Admin-Project: True May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Id: default May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Domain-Name: Default May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Id: 2916873d987d427191912a741b2eb373 May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Project-Name: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Role: member,reader May 11 07:49:52.927103 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Roles: member,reader May 11 07:49:52.928667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2916873d987d427191912a741b2eb373", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2916873d987d427191912a741b2eb373"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2916873d987d427191912a741b2eb373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2916873d987d427191912a741b2eb373"}]}] May 11 07:49:52.928667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.928667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Id: 2916873d987d427191912a741b2eb373 May 11 07:49:52.928667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-Tenant-Name: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.928667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User: tempest-VolumesNegativeTest-392144809-project May 11 07:49:52.928667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Id: default May 11 07:49:52.928667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Domain-Name: Default May 11 07:49:52.928667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Id: dad07833fe1d4c5a952969a5befe5cbc May 11 07:49:52.928667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: X-User-Name: tempest-VolumesNegativeTest-392144809-project May 11 07:49:52.928667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: method: May 11 07:49:52.928667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: exception: Volume 6b49a7f2-d2c2-44da-9e73-deccf207e27e could not be found. May 11 07:49:52.928667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: action_args: {'id': '6b49a7f2-d2c2-44da-9e73-deccf207e27e'} May 11 07:49:52.928667 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b49a7f2-d2c2-44da-9e73-deccf207e27e could not be found. (HTTP 404) (Request-ID: req-88675373-78df-4ecd-b202-41734c208140) May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.929844 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 07:49:52.931246 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b49a7f2-d2c2-44da-9e73-deccf207e27e could not be found. May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 07:49:52.932457 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:49:52.933955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b49a7f2-d2c2-44da-9e73-deccf207e27e could not be found. May 11 07:49:52.933955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.933955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.933955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.933955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.933955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:52.933955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:52.933955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:49:52.933955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:49:52.933955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b49a7f2-d2c2-44da-9e73-deccf207e27e could not be found. May 11 07:49:52.933955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR nova.api.openstack.wsgi May 11 07:49:52.933955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e111ffab-82eb-48a2-84a5-2e33e0c6d2f0 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Returning 404 to user: Volume 6b49a7f2-d2c2-44da-9e73-deccf207e27e could not be found. {{(pid=123600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:52.933955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e111ffab-82eb-48a2-84a5-2e33e0c6d2f0 tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/6b49a7f2-d2c2-44da-9e73-deccf207e27e" status: 404 len: 109 microversion: 2.1 time: 0.035479 May 11 07:49:52.933955 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 461/918] 10.222.0.36 () {58 vars in 1247 bytes} [Wed May 11 07:49:52 2022] DELETE /compute/v2.1/os-volumes/6b49a7f2-d2c2-44da-9e73-deccf207e27e => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:49:52.937974 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-9cd61960-f448-4b9f-a30b-e41770cdd4ab tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Calling method '.version_select at 0x7f19ec897820>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:49:52.963670 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-9cd61960-f448-4b9f-a30b-e41770cdd4ab tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] HTTP exception thrown: Volume 65274132-f267-4e22-bced-465e59f2f840 could not be found. May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-9cd61960-f448-4b9f-a30b-e41770cdd4ab tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Request method failure captured: May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/os-volumes/65274132-f267-4e22-bced-465e59f2f840 HTTP/1.1 May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2qgOoQFpv4S1gL-0_WJO_FUYWHstjxFAS0r2Syl6eM4AkH67TBBWpHg5pLBvtGUE4xHe1aWL5wy4q6SCgeVCaA0_6caA-xrExekvK1qI9mRzhp3smDkXqZb6IS4V-6sr7M5ELJ3WIW7bbrf9heUVjhsByuJhJytM_M061b5Ny96xes May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 2916873d987d427191912a741b2eb373 May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:49:52.965611 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:49:52.967190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_2916873d987d427191912a741b2eb373", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2916873d987d427191912a741b2eb373"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/2916873d987d427191912a741b2eb373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/2916873d987d427191912a741b2eb373"}]}] May 11 07:49:52.967190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.967190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 2916873d987d427191912a741b2eb373 May 11 07:49:52.967190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-VolumesNegativeTest-392144809 May 11 07:49:52.967190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-VolumesNegativeTest-392144809-project May 11 07:49:52.967190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:49:52.967190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:49:52.967190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: dad07833fe1d4c5a952969a5befe5cbc May 11 07:49:52.967190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-VolumesNegativeTest-392144809-project May 11 07:49:52.967190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: May 11 07:49:52.967190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Volume 65274132-f267-4e22-bced-465e59f2f840 could not be found. May 11 07:49:52.967190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '65274132-f267-4e22-bced-465e59f2f840'} May 11 07:49:52.967190 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 65274132-f267-4e22-bced-465e59f2f840 could not be found. (HTTP 404) (Request-ID: req-f0ed95c3-8830-477c-9c49-90360837e713) May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.968194 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 07:49:52.969605 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 65274132-f267-4e22-bced-465e59f2f840 could not be found. May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 07:49:52.971894 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:49:52.973816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 65274132-f267-4e22-bced-465e59f2f840 could not be found. May 11 07:49:52.973816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.973816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:49:52.973816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.973816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:49:52.973816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:49:52.973816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:49:52.973816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:49:52.973816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:49:52.973816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 65274132-f267-4e22-bced-465e59f2f840 could not be found. May 11 07:49:52.973816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:49:52.973816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-9cd61960-f448-4b9f-a30b-e41770cdd4ab tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] Returning 404 to user: Volume 65274132-f267-4e22-bced-465e59f2f840 could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:49:52.973816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-9cd61960-f448-4b9f-a30b-e41770cdd4ab tempest-VolumesNegativeTest-392144809 tempest-VolumesNegativeTest-392144809-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/65274132-f267-4e22-bced-465e59f2f840" status: 404 len: 109 microversion: 2.1 time: 0.032887 May 11 07:49:52.973816 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 458/919] 10.222.0.36 () {58 vars in 1244 bytes} [Wed May 11 07:49:52 2022] GET /compute/v2.1/os-volumes/65274132-f267-4e22-bced-465e59f2f840 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:50:58.618616 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-f9347fef-633c-4e05-bd93-2f68f74d35ad tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Action: 'create', calling method: .version_select at 0x7f19ec87ab80>, body: {"keypair": {"name": "tempest-TestShelveInstance-970951253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/wq6ZtBV0/Q6DWcmOrxYlGs0Z2bhPqom5Q5wvgYh0avFV4UDQ0A+acvZKZDv4jn9VjtSxqw/6Rhe+fFojo5hhrvdPoMadrxDNuBDNd7WIRv3Ju7f9aRe/f+NlpbXXzKA=="}} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:50:58.632870 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-f9347fef-633c-4e05-bd93-2f68f74d35ad tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Getting quotas for project 919cd09d224147718daec2e2203980f6. Resources: {'key_pairs'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:50:58.637396 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.quota [None req-f9347fef-633c-4e05-bd93-2f68f74d35ad tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Getting quotas for user cb4b533b8bbe4cbabf2780c82f04e44d and project 919cd09d224147718daec2e2203980f6. Resources: {'key_pairs'} {{(pid=123600) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:50:58.661230 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-f9347fef-633c-4e05-bd93-2f68f74d35ad tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.224046 May 11 07:50:58.661860 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 462/920] 10.222.0.36 () {60 vars in 1158 bytes} [Wed May 11 07:50:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:51:14.769256 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1609482698", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-970951253", "security_groups": [{"name": "tempest-secgroup-smoke-585561289"}], "networks": [{"uuid": "860be0b9-b423-481f-a303-c91ab123d363"}], "block_device_mapping_v2": [{"uuid": "b1ab604a-f94d-4835-bbd0-1835f22d93c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:51:14.874938 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.network.neutron [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] validate_networks() for [('860be0b9-b423-481f-a303-c91ab123d363', None, None, None, None, None)] {{(pid=123599) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 07:51:15.231249 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Flavor limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 07:51:15.231718 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Image limits 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 07:51:15.232189 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Flavor pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 07:51:15.232589 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Image pref 0:0:0 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 07:51:15.233044 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.virt.hardware [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123599) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 07:51:15.241370 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:15.241846 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:15.242638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:15.243180 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:15.260133 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Getting quotas for project 919cd09d224147718daec2e2203980f6. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 07:51:15.264308 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.quota [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Getting quotas for user cb4b533b8bbe4cbabf2780c82f04e44d and project 919cd09d224147718daec2e2203980f6. Resources: {'instances', 'ram', 'cores'} {{(pid=123599) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 07:51:15.318026 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Going to run 1 instances... {{(pid=123599) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 07:51:15.320362 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1ab604a-f94d-4835-bbd0-1835f22d93c8',volume_size=None,volume_type=None)] {{(pid=123599) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 07:51:15.440309 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ac4aec9b-8908-4ae7-9c0c-9a03d17b9d63 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.676251 May 11 07:51:15.440947 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 459/921] 10.222.0.36 () {60 vars in 1146 bytes} [Wed May 11 07:51:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 07:51:15.452438 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d44b3a7b-4511-4714-b814-204b030b1af0 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:15.453241 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d44b3a7b-4511-4714-b814-204b030b1af0 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:15.506270 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d44b3a7b-4511-4714-b814-204b030b1af0 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:15.512622 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d44b3a7b-4511-4714-b814-204b030b1af0 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1088 microversion: 2.1 time: 0.065069 May 11 07:51:15.513776 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 463/922] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:15 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:51:16.530533 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-649d6c98-a4a1-4ad4-8f84-20751cb54a3a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:16.531209 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-649d6c98-a4a1-4ad4-8f84-20751cb54a3a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:16.539175 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-649d6c98-a4a1-4ad4-8f84-20751cb54a3a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:16.539622 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-649d6c98-a4a1-4ad4-8f84-20751cb54a3a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:16.540390 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-649d6c98-a4a1-4ad4-8f84-20751cb54a3a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:16.540822 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-649d6c98-a4a1-4ad4-8f84-20751cb54a3a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:16.600479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-649d6c98-a4a1-4ad4-8f84-20751cb54a3a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:16.608069 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-649d6c98-a4a1-4ad4-8f84-20751cb54a3a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1204 microversion: 2.1 time: 0.081867 May 11 07:51:16.608622 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 460/923] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:16 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1204 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:51:17.624821 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-4e215678-1a86-4cec-9da9-c6958896b960 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:17.625437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-4e215678-1a86-4cec-9da9-c6958896b960 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:17.632828 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4e215678-1a86-4cec-9da9-c6958896b960 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:17.633284 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4e215678-1a86-4cec-9da9-c6958896b960 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:17.634101 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4e215678-1a86-4cec-9da9-c6958896b960 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:17.634541 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-4e215678-1a86-4cec-9da9-c6958896b960 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:17.703244 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-7a63541d-3fe8-459b-a053-e1785a27a180 req-95c6e1e5-ab7f-4420-ae86-d8a5b7c24052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a0a427-0bcd-456c-820d-3b18a16e2ffb", "tag": "ec69841a-e2d2-48f2-87f6-b5b4e8c4bb40"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:51:17.713677 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-7a63541d-3fe8-459b-a053-e1785a27a180 req-95c6e1e5-ab7f-4420-ae86-d8a5b7c24052 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:17.714146 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-7a63541d-3fe8-459b-a053-e1785a27a180 req-95c6e1e5-ab7f-4420-ae86-d8a5b7c24052 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:17.731638 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-7a63541d-3fe8-459b-a053-e1785a27a180 req-95c6e1e5-ab7f-4420-ae86-d8a5b7c24052 service nova] Creating event network-changed:ec69841a-e2d2-48f2-87f6-b5b4e8c4bb40 for instance 04a0a427-0bcd-456c-820d-3b18a16e2ffb on hv-cinder-83699 May 11 07:51:17.737014 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-7a63541d-3fe8-459b-a053-e1785a27a180 req-95c6e1e5-ab7f-4420-ae86-d8a5b7c24052 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038181 May 11 07:51:17.738161 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 461/924] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:51:17.788538 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-4e215678-1a86-4cec-9da9-c6958896b960 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:17.796762 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-4e215678-1a86-4cec-9da9-c6958896b960 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1259 microversion: 2.1 time: 0.176281 May 11 07:51:17.797975 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 464/925] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:17 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:51:18.815178 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-508821b5-f376-4825-bc67-1cf47e6fbc26 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:18.815865 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-508821b5-f376-4825-bc67-1cf47e6fbc26 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:18.822228 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-508821b5-f376-4825-bc67-1cf47e6fbc26 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:18.822731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-508821b5-f376-4825-bc67-1cf47e6fbc26 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:18.823439 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-508821b5-f376-4825-bc67-1cf47e6fbc26 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:18.823869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-508821b5-f376-4825-bc67-1cf47e6fbc26 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:18.952972 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-508821b5-f376-4825-bc67-1cf47e6fbc26 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:18.960259 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-508821b5-f376-4825-bc67-1cf47e6fbc26 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1259 microversion: 2.1 time: 0.149740 May 11 07:51:18.960817 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 462/926] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:18 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:51:19.976669 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-c6111dac-db43-4b2b-b4ed-f34c0b6f8f1c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:19.977281 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-c6111dac-db43-4b2b-b4ed-f34c0b6f8f1c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:19.983630 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c6111dac-db43-4b2b-b4ed-f34c0b6f8f1c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:19.984079 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c6111dac-db43-4b2b-b4ed-f34c0b6f8f1c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:19.984836 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c6111dac-db43-4b2b-b4ed-f34c0b6f8f1c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:19.985272 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-c6111dac-db43-4b2b-b4ed-f34c0b6f8f1c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:20.111866 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-c6111dac-db43-4b2b-b4ed-f34c0b6f8f1c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:20.119071 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-c6111dac-db43-4b2b-b4ed-f34c0b6f8f1c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1259 microversion: 2.1 time: 0.146216 May 11 07:51:20.119822 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 465/927] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:19 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:51:21.136254 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2d5f1a7e-6421-41ec-bc34-b076e9f01f1b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:21.136922 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2d5f1a7e-6421-41ec-bc34-b076e9f01f1b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:21.145699 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a7e-6421-41ec-bc34-b076e9f01f1b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:21.146145 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a7e-6421-41ec-bc34-b076e9f01f1b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:21.146905 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a7e-6421-41ec-bc34-b076e9f01f1b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:21.147334 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2d5f1a7e-6421-41ec-bc34-b076e9f01f1b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:21.276560 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2d5f1a7e-6421-41ec-bc34-b076e9f01f1b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:21.284445 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2d5f1a7e-6421-41ec-bc34-b076e9f01f1b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1259 microversion: 2.1 time: 0.152004 May 11 07:51:21.285000 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 463/928] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:21 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:51:22.301548 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-04db4d1a-6c11-4634-b7a9-59338f73b091 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:22.302180 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-04db4d1a-6c11-4634-b7a9-59338f73b091 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:22.308463 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-04db4d1a-6c11-4634-b7a9-59338f73b091 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:22.308907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-04db4d1a-6c11-4634-b7a9-59338f73b091 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:22.309735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-04db4d1a-6c11-4634-b7a9-59338f73b091 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:22.310272 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-04db4d1a-6c11-4634-b7a9-59338f73b091 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:22.433565 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-04db4d1a-6c11-4634-b7a9-59338f73b091 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:22.440838 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-04db4d1a-6c11-4634-b7a9-59338f73b091 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1259 microversion: 2.1 time: 0.143093 May 11 07:51:22.441400 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 466/929] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:22 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:51:23.457564 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-fd3d4ce7-05d3-4671-937d-b87376f96bbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:23.458180 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-fd3d4ce7-05d3-4671-937d-b87376f96bbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:23.464543 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd3d4ce7-05d3-4671-937d-b87376f96bbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:23.464993 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd3d4ce7-05d3-4671-937d-b87376f96bbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:23.465792 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd3d4ce7-05d3-4671-937d-b87376f96bbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:23.466229 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd3d4ce7-05d3-4671-937d-b87376f96bbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:23.597650 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-fd3d4ce7-05d3-4671-937d-b87376f96bbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:23.604920 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-fd3d4ce7-05d3-4671-937d-b87376f96bbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1259 microversion: 2.1 time: 0.151310 May 11 07:51:23.605480 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 464/930] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:23 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:51:24.620760 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-d18d6500-1769-4315-8c30-b92298e0ab42 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:24.621371 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-d18d6500-1769-4315-8c30-b92298e0ab42 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:24.627719 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d18d6500-1769-4315-8c30-b92298e0ab42 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:24.628172 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d18d6500-1769-4315-8c30-b92298e0ab42 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:24.628937 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d18d6500-1769-4315-8c30-b92298e0ab42 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:24.629379 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-d18d6500-1769-4315-8c30-b92298e0ab42 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:24.757002 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-d18d6500-1769-4315-8c30-b92298e0ab42 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:24.764209 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-d18d6500-1769-4315-8c30-b92298e0ab42 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1259 microversion: 2.1 time: 0.147347 May 11 07:51:24.764773 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 467/931] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:24 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:51:25.780208 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7a059060-93dc-4953-ae12-97f944bae957 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:25.780753 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-7a059060-93dc-4953-ae12-97f944bae957 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:25.787098 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7a059060-93dc-4953-ae12-97f944bae957 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:25.787551 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7a059060-93dc-4953-ae12-97f944bae957 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:25.788320 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7a059060-93dc-4953-ae12-97f944bae957 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:25.788760 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7a059060-93dc-4953-ae12-97f944bae957 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:26.183372 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-7a059060-93dc-4953-ae12-97f944bae957 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:26.191705 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-7a059060-93dc-4953-ae12-97f944bae957 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1259 microversion: 2.1 time: 0.415379 May 11 07:51:26.192272 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 465/932] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:25 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1259 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:51:27.208204 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-fd6cf750-9f3d-4421-b2bb-ac61447e3a25 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:27.208835 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-fd6cf750-9f3d-4421-b2bb-ac61447e3a25 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:27.215079 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fd6cf750-9f3d-4421-b2bb-ac61447e3a25 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:27.215521 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fd6cf750-9f3d-4421-b2bb-ac61447e3a25 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:27.216275 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fd6cf750-9f3d-4421-b2bb-ac61447e3a25 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:27.216711 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-fd6cf750-9f3d-4421-b2bb-ac61447e3a25 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:27.341845 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-fd6cf750-9f3d-4421-b2bb-ac61447e3a25 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:27.348996 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-fd6cf750-9f3d-4421-b2bb-ac61447e3a25 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1259 microversion: 2.1 time: 0.144665 May 11 07:51:27.349564 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 468/933] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:27 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:51:28.366244 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-94a7d0bb-d278-44b0-8581-c3fe6287684a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:28.366944 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-94a7d0bb-d278-44b0-8581-c3fe6287684a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:28.373815 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-94a7d0bb-d278-44b0-8581-c3fe6287684a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:28.374341 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-94a7d0bb-d278-44b0-8581-c3fe6287684a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:28.375221 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-94a7d0bb-d278-44b0-8581-c3fe6287684a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:28.375652 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-94a7d0bb-d278-44b0-8581-c3fe6287684a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:28.519590 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-94a7d0bb-d278-44b0-8581-c3fe6287684a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:28.527214 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-94a7d0bb-d278-44b0-8581-c3fe6287684a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1259 microversion: 2.1 time: 0.164859 May 11 07:51:28.527767 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 466/934] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:28 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:51:28.546501 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-4619181b-d486-434d-94f1-3ba672284dcb req-644b15ea-12c9-4b47-83fa-c433a02bca81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a0a427-0bcd-456c-820d-3b18a16e2ffb", "name": "network-vif-plugged", "status": "completed", "tag": "ec69841a-e2d2-48f2-87f6-b5b4e8c4bb40"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:51:28.554293 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-4619181b-d486-434d-94f1-3ba672284dcb req-644b15ea-12c9-4b47-83fa-c433a02bca81 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:28.554735 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-4619181b-d486-434d-94f1-3ba672284dcb req-644b15ea-12c9-4b47-83fa-c433a02bca81 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:28.565560 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-4619181b-d486-434d-94f1-3ba672284dcb req-644b15ea-12c9-4b47-83fa-c433a02bca81 service nova] Creating event network-vif-plugged:ec69841a-e2d2-48f2-87f6-b5b4e8c4bb40 for instance 04a0a427-0bcd-456c-820d-3b18a16e2ffb on hv-cinder-83699 May 11 07:51:28.570838 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-4619181b-d486-434d-94f1-3ba672284dcb req-644b15ea-12c9-4b47-83fa-c433a02bca81 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125200 May 11 07:51:28.571401 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 469/935] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:51:29.543056 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-11e0837d-0092-4980-813c-8f4259e65233 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:29.543686 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-11e0837d-0092-4980-813c-8f4259e65233 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:29.550421 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-11e0837d-0092-4980-813c-8f4259e65233 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:29.550864 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-11e0837d-0092-4980-813c-8f4259e65233 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:29.551614 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-11e0837d-0092-4980-813c-8f4259e65233 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:29.552043 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-11e0837d-0092-4980-813c-8f4259e65233 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:29.675959 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-11e0837d-0092-4980-813c-8f4259e65233 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:29.683080 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-11e0837d-0092-4980-813c-8f4259e65233 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1259 microversion: 2.1 time: 0.143894 May 11 07:51:29.683623 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 467/936] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:29 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:51:30.702290 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7f301389-0d31-4033-af47-1ea4ce92178a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:30.702990 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7f301389-0d31-4033-af47-1ea4ce92178a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:30.709516 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7f301389-0d31-4033-af47-1ea4ce92178a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:30.710013 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7f301389-0d31-4033-af47-1ea4ce92178a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:30.710790 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7f301389-0d31-4033-af47-1ea4ce92178a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:30.711230 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7f301389-0d31-4033-af47-1ea4ce92178a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:30.836104 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7f301389-0d31-4033-af47-1ea4ce92178a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:30.843424 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7f301389-0d31-4033-af47-1ea4ce92178a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1443 microversion: 2.1 time: 0.146692 May 11 07:51:30.843981 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 470/937] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:30 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1443 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:51:30.859516 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-b4f79b82-144d-40d1-adea-4452195d0cc9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:51:30.860132 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-b4f79b82-144d-40d1-adea-4452195d0cc9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:51:30.866443 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b4f79b82-144d-40d1-adea-4452195d0cc9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:30.866890 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b4f79b82-144d-40d1-adea-4452195d0cc9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:30.867664 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b4f79b82-144d-40d1-adea-4452195d0cc9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:30.868101 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-b4f79b82-144d-40d1-adea-4452195d0cc9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:30.994555 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-b4f79b82-144d-40d1-adea-4452195d0cc9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:51:31.003066 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-b4f79b82-144d-40d1-adea-4452195d0cc9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1443 microversion: 2.1 time: 0.147896 May 11 07:51:31.003631 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 468/938] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:51:30 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1443 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:51:32.749889 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-86b80a70-fe24-49aa-8389-a1968c4919a6 req-df8b6b0b-2b3a-4e3a-b804-59a71ab345dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a0a427-0bcd-456c-820d-3b18a16e2ffb", "tag": "ec69841a-e2d2-48f2-87f6-b5b4e8c4bb40"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:51:32.757600 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-86b80a70-fe24-49aa-8389-a1968c4919a6 req-df8b6b0b-2b3a-4e3a-b804-59a71ab345dd service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:51:32.758049 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-86b80a70-fe24-49aa-8389-a1968c4919a6 req-df8b6b0b-2b3a-4e3a-b804-59a71ab345dd service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:51:32.768495 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-86b80a70-fe24-49aa-8389-a1968c4919a6 req-df8b6b0b-2b3a-4e3a-b804-59a71ab345dd service nova] Creating event network-changed:ec69841a-e2d2-48f2-87f6-b5b4e8c4bb40 for instance 04a0a427-0bcd-456c-820d-3b18a16e2ffb on hv-cinder-83699 May 11 07:51:32.773642 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-86b80a70-fe24-49aa-8389-a1968c4919a6 req-df8b6b0b-2b3a-4e3a-b804-59a71ab345dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083810 May 11 07:51:32.774143 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 471/939] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:51:47.832862 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 07:51:47.833461 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Wed May 11 07:51:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 07:53:30.113900 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-fa777276-48c1-4860-8a29-6f8f2ea72e97 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:53:30.114507 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-fa777276-48c1-4860-8a29-6f8f2ea72e97 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:30.120310 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fa777276-48c1-4860-8a29-6f8f2ea72e97 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:30.120754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fa777276-48c1-4860-8a29-6f8f2ea72e97 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:30.121521 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fa777276-48c1-4860-8a29-6f8f2ea72e97 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:30.121987 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fa777276-48c1-4860-8a29-6f8f2ea72e97 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:30.143952 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.objects.instance [None req-fa777276-48c1-4860-8a29-6f8f2ea72e97 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lazy-loading 'flavor' on Instance uuid 04a0a427-0bcd-456c-820d-3b18a16e2ffb {{(pid=123599) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 07:53:30.211536 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-fa777276-48c1-4860-8a29-6f8f2ea72e97 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "POST /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb/action" status: 202 len: 0 microversion: 2.1 time: 0.102411 May 11 07:53:30.212103 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 469/940] 10.222.0.36 () {60 vars in 1277 bytes} [Wed May 11 07:53:30 2022] POST /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:53:30.218975 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ba6bf417-cd40-473b-9524-216eed467310] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 11 07:53:30.223929 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-642ac9dd-d8a2-49c4-a0aa-230f91a9540e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:30.224630 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-642ac9dd-d8a2-49c4-a0aa-230f91a9540e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:30.231266 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-642ac9dd-d8a2-49c4-a0aa-230f91a9540e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:30.231800 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-642ac9dd-d8a2-49c4-a0aa-230f91a9540e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:30.232629 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-642ac9dd-d8a2-49c4-a0aa-230f91a9540e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:30.233063 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-642ac9dd-d8a2-49c4-a0aa-230f91a9540e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:30.362586 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-642ac9dd-d8a2-49c4-a0aa-230f91a9540e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:30.370013 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-642ac9dd-d8a2-49c4-a0aa-230f91a9540e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1568 microversion: 2.1 time: 0.153389 May 11 07:53:30.370497 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 472/941] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:30 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:31.389236 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-21089428-b458-4bf5-8ebf-13edc95ac39c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:31.389956 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-21089428-b458-4bf5-8ebf-13edc95ac39c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:31.396029 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-21089428-b458-4bf5-8ebf-13edc95ac39c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:31.396474 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-21089428-b458-4bf5-8ebf-13edc95ac39c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:31.397232 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-21089428-b458-4bf5-8ebf-13edc95ac39c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:31.397698 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-21089428-b458-4bf5-8ebf-13edc95ac39c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:31.575367 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-21089428-b458-4bf5-8ebf-13edc95ac39c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:31.583261 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-21089428-b458-4bf5-8ebf-13edc95ac39c tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1568 microversion: 2.1 time: 0.198841 May 11 07:53:31.583810 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 470/942] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:31 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:32.600745 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-294fd20f-27e3-43cf-8777-67e72ccb4e23 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:32.601367 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-294fd20f-27e3-43cf-8777-67e72ccb4e23 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:32.611810 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-294fd20f-27e3-43cf-8777-67e72ccb4e23 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:32.612264 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-294fd20f-27e3-43cf-8777-67e72ccb4e23 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:32.613036 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-294fd20f-27e3-43cf-8777-67e72ccb4e23 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:32.613475 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-294fd20f-27e3-43cf-8777-67e72ccb4e23 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:32.616884 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO oslo.messaging._drivers.impl_rabbit [-] [ba6bf417-cd40-473b-9524-216eed467310] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 53222. May 11 07:53:32.739956 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-294fd20f-27e3-43cf-8777-67e72ccb4e23 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:32.747236 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-294fd20f-27e3-43cf-8777-67e72ccb4e23 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1568 microversion: 2.1 time: 0.150349 May 11 07:53:32.747792 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 473/943] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:32 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:33.764019 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-172c6890-9c4c-4f63-b7eb-256c129f05a2 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:33.764624 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-172c6890-9c4c-4f63-b7eb-256c129f05a2 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:33.770731 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-172c6890-9c4c-4f63-b7eb-256c129f05a2 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:33.771180 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-172c6890-9c4c-4f63-b7eb-256c129f05a2 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:33.771959 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-172c6890-9c4c-4f63-b7eb-256c129f05a2 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:33.772393 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-172c6890-9c4c-4f63-b7eb-256c129f05a2 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:33.898551 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-172c6890-9c4c-4f63-b7eb-256c129f05a2 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:33.905792 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-172c6890-9c4c-4f63-b7eb-256c129f05a2 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1568 microversion: 2.1 time: 0.145644 May 11 07:53:33.906352 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 471/944] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:33 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:34.923430 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-5d93e92e-59b2-41c4-a011-7f5d70ff622a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:34.924042 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-5d93e92e-59b2-41c4-a011-7f5d70ff622a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:34.930437 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5d93e92e-59b2-41c4-a011-7f5d70ff622a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:34.930897 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5d93e92e-59b2-41c4-a011-7f5d70ff622a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:34.931670 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5d93e92e-59b2-41c4-a011-7f5d70ff622a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:34.932109 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-5d93e92e-59b2-41c4-a011-7f5d70ff622a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:35.069682 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-5d93e92e-59b2-41c4-a011-7f5d70ff622a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:35.077148 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-5d93e92e-59b2-41c4-a011-7f5d70ff622a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1568 microversion: 2.1 time: 0.157574 May 11 07:53:35.077729 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 474/945] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:34 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:36.095485 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-e0dd71c6-0bed-438f-94a5-17da75f9b03e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:36.096101 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-e0dd71c6-0bed-438f-94a5-17da75f9b03e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:36.102364 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e0dd71c6-0bed-438f-94a5-17da75f9b03e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:36.102847 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e0dd71c6-0bed-438f-94a5-17da75f9b03e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:36.103613 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e0dd71c6-0bed-438f-94a5-17da75f9b03e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:36.104046 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-e0dd71c6-0bed-438f-94a5-17da75f9b03e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:36.230127 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-e0dd71c6-0bed-438f-94a5-17da75f9b03e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:36.237404 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-e0dd71c6-0bed-438f-94a5-17da75f9b03e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1568 microversion: 2.1 time: 0.146407 May 11 07:53:36.237983 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 472/946] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:36 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:37.254531 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-558eeb9d-4e64-47fb-a445-5873daaf385b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:37.255146 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-558eeb9d-4e64-47fb-a445-5873daaf385b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:37.261383 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-558eeb9d-4e64-47fb-a445-5873daaf385b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:37.261870 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-558eeb9d-4e64-47fb-a445-5873daaf385b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:37.262655 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-558eeb9d-4e64-47fb-a445-5873daaf385b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:37.263096 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-558eeb9d-4e64-47fb-a445-5873daaf385b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:37.450950 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-558eeb9d-4e64-47fb-a445-5873daaf385b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:37.459037 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-558eeb9d-4e64-47fb-a445-5873daaf385b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1568 microversion: 2.1 time: 0.208433 May 11 07:53:37.459605 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 475/947] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:37 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:38.475253 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-94a788b9-051a-47fe-83b4-6036e605559e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:38.475861 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-94a788b9-051a-47fe-83b4-6036e605559e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:38.482235 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-94a788b9-051a-47fe-83b4-6036e605559e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:38.482685 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-94a788b9-051a-47fe-83b4-6036e605559e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:38.483453 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-94a788b9-051a-47fe-83b4-6036e605559e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:38.483888 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-94a788b9-051a-47fe-83b4-6036e605559e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:38.611045 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-94a788b9-051a-47fe-83b4-6036e605559e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:38.618221 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-94a788b9-051a-47fe-83b4-6036e605559e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1568 microversion: 2.1 time: 0.146838 May 11 07:53:38.618782 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 473/948] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:38 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:39.396431 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 07:53:39.396672 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Wed May 11 07:53:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 07:53:39.634773 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-32b8f9e7-9541-4731-acde-6218053fa197 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:39.635380 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-32b8f9e7-9541-4731-acde-6218053fa197 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:39.642505 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-32b8f9e7-9541-4731-acde-6218053fa197 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:39.642957 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-32b8f9e7-9541-4731-acde-6218053fa197 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:39.643723 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-32b8f9e7-9541-4731-acde-6218053fa197 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:39.644157 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-32b8f9e7-9541-4731-acde-6218053fa197 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:39.777429 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-32b8f9e7-9541-4731-acde-6218053fa197 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:39.784632 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-32b8f9e7-9541-4731-acde-6218053fa197 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1568 microversion: 2.1 time: 0.153732 May 11 07:53:39.785397 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 476/949] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:39 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 07:53:40.801446 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-2c004a50-70c6-4b4e-98a4-03f62696e8b7 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:40.802751 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-2c004a50-70c6-4b4e-98a4-03f62696e8b7 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:40.809178 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c004a50-70c6-4b4e-98a4-03f62696e8b7 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:40.809665 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c004a50-70c6-4b4e-98a4-03f62696e8b7 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:40.810510 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c004a50-70c6-4b4e-98a4-03f62696e8b7 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:40.810948 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-2c004a50-70c6-4b4e-98a4-03f62696e8b7 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:40.938552 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-2c004a50-70c6-4b4e-98a4-03f62696e8b7 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:40.946306 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-2c004a50-70c6-4b4e-98a4-03f62696e8b7 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1568 microversion: 2.1 time: 0.148652 May 11 07:53:40.946861 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 474/950] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:40 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:41.963166 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-9c048ed7-f280-487f-b61c-7ef6724351c9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:41.963783 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-9c048ed7-f280-487f-b61c-7ef6724351c9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:41.970720 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9c048ed7-f280-487f-b61c-7ef6724351c9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:41.971183 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9c048ed7-f280-487f-b61c-7ef6724351c9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:41.971958 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9c048ed7-f280-487f-b61c-7ef6724351c9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:41.972401 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-9c048ed7-f280-487f-b61c-7ef6724351c9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:42.100760 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-9c048ed7-f280-487f-b61c-7ef6724351c9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:42.108010 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-9c048ed7-f280-487f-b61c-7ef6724351c9 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1568 microversion: 2.1 time: 0.148738 May 11 07:53:42.108571 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 477/951] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:41 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:43.124960 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-13ab794d-6c16-41b1-bdd1-a82fa3a831c1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:43.125561 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-13ab794d-6c16-41b1-bdd1-a82fa3a831c1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:43.131870 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-13ab794d-6c16-41b1-bdd1-a82fa3a831c1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:43.132312 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-13ab794d-6c16-41b1-bdd1-a82fa3a831c1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:43.133071 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-13ab794d-6c16-41b1-bdd1-a82fa3a831c1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:43.133502 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-13ab794d-6c16-41b1-bdd1-a82fa3a831c1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:43.268669 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-13ab794d-6c16-41b1-bdd1-a82fa3a831c1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:43.276173 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-13ab794d-6c16-41b1-bdd1-a82fa3a831c1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1568 microversion: 2.1 time: 0.155091 May 11 07:53:43.276926 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 475/952] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:43 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:44.293938 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-746d317b-f7cb-433d-8944-bc005a3e7a3e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:44.294543 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-746d317b-f7cb-433d-8944-bc005a3e7a3e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:44.301357 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-746d317b-f7cb-433d-8944-bc005a3e7a3e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:44.301841 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-746d317b-f7cb-433d-8944-bc005a3e7a3e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:44.302613 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-746d317b-f7cb-433d-8944-bc005a3e7a3e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:44.303060 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-746d317b-f7cb-433d-8944-bc005a3e7a3e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:44.426752 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-746d317b-f7cb-433d-8944-bc005a3e7a3e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:44.433879 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-746d317b-f7cb-433d-8944-bc005a3e7a3e tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1509 microversion: 2.1 time: 0.143833 May 11 07:53:44.434432 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 478/953] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:44 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1509 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:44.451000 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-ed8b7e0a-fe63-4767-bf7c-4d26221d8653 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:53:44.451565 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-ed8b7e0a-fe63-4767-bf7c-4d26221d8653 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:44.457869 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ed8b7e0a-fe63-4767-bf7c-4d26221d8653 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:44.458317 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ed8b7e0a-fe63-4767-bf7c-4d26221d8653 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:44.459075 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ed8b7e0a-fe63-4767-bf7c-4d26221d8653 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:44.459503 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-ed8b7e0a-fe63-4767-bf7c-4d26221d8653 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:44.600111 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-ed8b7e0a-fe63-4767-bf7c-4d26221d8653 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "POST /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb/action" status: 202 len: 0 microversion: 2.1 time: 0.152495 May 11 07:53:44.600727 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 476/954] 10.222.0.36 () {60 vars in 1277 bytes} [Wed May 11 07:53:44 2022] POST /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:53:44.608897 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-68b570ee-0757-4ed8-86b7-36a0692dd723 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:44.610706 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-68b570ee-0757-4ed8-86b7-36a0692dd723 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:44.617568 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-68b570ee-0757-4ed8-86b7-36a0692dd723 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:44.618339 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-68b570ee-0757-4ed8-86b7-36a0692dd723 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:44.618874 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-68b570ee-0757-4ed8-86b7-36a0692dd723 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:44.619321 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-68b570ee-0757-4ed8-86b7-36a0692dd723 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:44.787285 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-68b570ee-0757-4ed8-86b7-36a0692dd723 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:44.795049 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-68b570ee-0757-4ed8-86b7-36a0692dd723 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1517 microversion: 2.1 time: 0.190083 May 11 07:53:44.795801 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 479/955] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:44 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:44.849489 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 07:53:44.850426 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Wed May 11 07:53:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 07:53:44.956901 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-67d1bfea-dc9b-4482-9ade-99a01055e8e3 req-ca00f68b-543b-4f06-9fb6-138a67650eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a0a427-0bcd-456c-820d-3b18a16e2ffb", "name": "network-vif-unplugged", "status": "completed", "tag": "ec69841a-e2d2-48f2-87f6-b5b4e8c4bb40"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:53:44.965810 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-67d1bfea-dc9b-4482-9ade-99a01055e8e3 req-ca00f68b-543b-4f06-9fb6-138a67650eac service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:44.966314 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-67d1bfea-dc9b-4482-9ade-99a01055e8e3 req-ca00f68b-543b-4f06-9fb6-138a67650eac service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:44.978234 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.compute.server_external_events [req-67d1bfea-dc9b-4482-9ade-99a01055e8e3 req-ca00f68b-543b-4f06-9fb6-138a67650eac service nova] Unable to find a host for instance 04a0a427-0bcd-456c-820d-3b18a16e2ffb. Dropping event network-vif-unplugged {{(pid=123599) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 11 07:53:44.979111 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-67d1bfea-dc9b-4482-9ade-99a01055e8e3 req-ca00f68b-543b-4f06-9fb6-138a67650eac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026631 May 11 07:53:44.980031 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 477/956] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 11 07:53:45.812305 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-ae5ae93e-7d8f-4986-9f20-69f4899a9115 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:45.813452 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-ae5ae93e-7d8f-4986-9f20-69f4899a9115 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:45.821001 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ae5ae93e-7d8f-4986-9f20-69f4899a9115 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:45.821698 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ae5ae93e-7d8f-4986-9f20-69f4899a9115 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:45.822958 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ae5ae93e-7d8f-4986-9f20-69f4899a9115 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:45.823411 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-ae5ae93e-7d8f-4986-9f20-69f4899a9115 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:45.961232 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-ae5ae93e-7d8f-4986-9f20-69f4899a9115 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:45.969257 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-ae5ae93e-7d8f-4986-9f20-69f4899a9115 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1519 microversion: 2.1 time: 0.160876 May 11 07:53:45.969907 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 480/957] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:45 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:46.986544 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-569bb26a-2a0d-4a95-8c7d-24ce9d40e2a1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:46.987162 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-569bb26a-2a0d-4a95-8c7d-24ce9d40e2a1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:46.993373 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-569bb26a-2a0d-4a95-8c7d-24ce9d40e2a1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:46.993862 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-569bb26a-2a0d-4a95-8c7d-24ce9d40e2a1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:46.994627 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-569bb26a-2a0d-4a95-8c7d-24ce9d40e2a1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:46.995061 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-569bb26a-2a0d-4a95-8c7d-24ce9d40e2a1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:47.121273 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-569bb26a-2a0d-4a95-8c7d-24ce9d40e2a1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:47.129137 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-569bb26a-2a0d-4a95-8c7d-24ce9d40e2a1 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1575 microversion: 2.1 time: 0.146435 May 11 07:53:47.129716 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 478/958] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:46 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:48.146169 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-8409b45f-e54a-4e6a-b1ac-d1c6beaf6f7b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:48.146856 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-8409b45f-e54a-4e6a-b1ac-d1c6beaf6f7b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:48.153085 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8409b45f-e54a-4e6a-b1ac-d1c6beaf6f7b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:48.153569 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8409b45f-e54a-4e6a-b1ac-d1c6beaf6f7b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:48.154345 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8409b45f-e54a-4e6a-b1ac-d1c6beaf6f7b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:48.154792 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-8409b45f-e54a-4e6a-b1ac-d1c6beaf6f7b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:48.291515 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-8409b45f-e54a-4e6a-b1ac-d1c6beaf6f7b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:48.299515 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-8409b45f-e54a-4e6a-b1ac-d1c6beaf6f7b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1575 microversion: 2.1 time: 0.157682 May 11 07:53:48.300118 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 481/959] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:48 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:49.316070 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7dd01808-4edf-4d69-9beb-37e167701c9b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:49.316678 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-7dd01808-4edf-4d69-9beb-37e167701c9b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:49.323307 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7dd01808-4edf-4d69-9beb-37e167701c9b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:49.323754 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7dd01808-4edf-4d69-9beb-37e167701c9b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:49.324515 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7dd01808-4edf-4d69-9beb-37e167701c9b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:49.324949 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7dd01808-4edf-4d69-9beb-37e167701c9b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:49.451779 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-7dd01808-4edf-4d69-9beb-37e167701c9b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:49.459655 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-7dd01808-4edf-4d69-9beb-37e167701c9b tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1575 microversion: 2.1 time: 0.147454 May 11 07:53:49.460208 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 479/960] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:49 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:50.177779 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 07:53:50.178296 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Wed May 11 07:53:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 07:53:50.476092 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3958e083-c322-4b0e-a4ba-2e54de986fbf tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:50.476626 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3958e083-c322-4b0e-a4ba-2e54de986fbf tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:50.483516 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3958e083-c322-4b0e-a4ba-2e54de986fbf tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:50.483969 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3958e083-c322-4b0e-a4ba-2e54de986fbf tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:50.485171 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3958e083-c322-4b0e-a4ba-2e54de986fbf tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:50.485171 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3958e083-c322-4b0e-a4ba-2e54de986fbf tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:50.614830 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3958e083-c322-4b0e-a4ba-2e54de986fbf tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:50.622125 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3958e083-c322-4b0e-a4ba-2e54de986fbf tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1575 microversion: 2.1 time: 0.149929 May 11 07:53:50.622683 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 482/961] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:50 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:51.638317 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-1f3837c2-6d51-4c22-8251-b0bd63c80993 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:51.638956 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-1f3837c2-6d51-4c22-8251-b0bd63c80993 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:51.646097 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1f3837c2-6d51-4c22-8251-b0bd63c80993 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:51.646552 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1f3837c2-6d51-4c22-8251-b0bd63c80993 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:51.647327 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1f3837c2-6d51-4c22-8251-b0bd63c80993 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:51.647763 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-1f3837c2-6d51-4c22-8251-b0bd63c80993 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:51.776883 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-1f3837c2-6d51-4c22-8251-b0bd63c80993 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:51.784211 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-1f3837c2-6d51-4c22-8251-b0bd63c80993 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1575 microversion: 2.1 time: 0.149785 May 11 07:53:51.784760 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 480/962] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:51 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:52.800805 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-3144cfff-b16c-4ab6-8b30-fa0e843b4ee8 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:52.801342 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-3144cfff-b16c-4ab6-8b30-fa0e843b4ee8 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:52.807701 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3144cfff-b16c-4ab6-8b30-fa0e843b4ee8 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:52.808133 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3144cfff-b16c-4ab6-8b30-fa0e843b4ee8 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:52.808901 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3144cfff-b16c-4ab6-8b30-fa0e843b4ee8 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:52.809336 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-3144cfff-b16c-4ab6-8b30-fa0e843b4ee8 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:52.934760 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-3144cfff-b16c-4ab6-8b30-fa0e843b4ee8 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:52.942647 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-3144cfff-b16c-4ab6-8b30-fa0e843b4ee8 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1575 microversion: 2.1 time: 0.145822 May 11 07:53:52.943207 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 483/963] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:52 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1575 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:53.959552 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-fd10f7c4-35e3-4acd-820e-e868e5273763 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:53.960180 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-fd10f7c4-35e3-4acd-820e-e868e5273763 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:53.966418 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd10f7c4-35e3-4acd-820e-e868e5273763 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:53.966860 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd10f7c4-35e3-4acd-820e-e868e5273763 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:53.967612 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd10f7c4-35e3-4acd-820e-e868e5273763 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:53.968041 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-fd10f7c4-35e3-4acd-820e-e868e5273763 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:54.099352 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-fd10f7c4-35e3-4acd-820e-e868e5273763 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:54.106626 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-fd10f7c4-35e3-4acd-820e-e868e5273763 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1575 microversion: 2.1 time: 0.150981 May 11 07:53:54.107179 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 481/964] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:53 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:55.062069 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [req-4c6feec6-5497-4749-9e39-e95f87e6ab34 req-8fd6e0f3-992f-4fdf-a785-cec59f7640d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a0a427-0bcd-456c-820d-3b18a16e2ffb", "name": "network-vif-plugged", "status": "completed", "tag": "ec69841a-e2d2-48f2-87f6-b5b4e8c4bb40"}]} {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:53:55.072543 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-4c6feec6-5497-4749-9e39-e95f87e6ab34 req-8fd6e0f3-992f-4fdf-a785-cec59f7640d3 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:55.073125 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [req-4c6feec6-5497-4749-9e39-e95f87e6ab34 req-8fd6e0f3-992f-4fdf-a785-cec59f7640d3 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:55.084859 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.compute.server_external_events [req-4c6feec6-5497-4749-9e39-e95f87e6ab34 req-8fd6e0f3-992f-4fdf-a785-cec59f7640d3 service nova] Creating event network-vif-plugged:ec69841a-e2d2-48f2-87f6-b5b4e8c4bb40 for instance 04a0a427-0bcd-456c-820d-3b18a16e2ffb on hv-cinder-83699 May 11 07:53:55.090834 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [req-4c6feec6-5497-4749-9e39-e95f87e6ab34 req-8fd6e0f3-992f-4fdf-a785-cec59f7640d3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032565 May 11 07:53:55.091410 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 484/965] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:53:55.124326 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-bc62fc98-267b-44f1-9c5d-f43ae8e93980 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:55.125068 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-bc62fc98-267b-44f1-9c5d-f43ae8e93980 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:55.132316 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bc62fc98-267b-44f1-9c5d-f43ae8e93980 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:55.132761 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bc62fc98-267b-44f1-9c5d-f43ae8e93980 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:55.133525 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bc62fc98-267b-44f1-9c5d-f43ae8e93980 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:55.134440 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-bc62fc98-267b-44f1-9c5d-f43ae8e93980 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:55.268957 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-bc62fc98-267b-44f1-9c5d-f43ae8e93980 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:55.276353 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-bc62fc98-267b-44f1-9c5d-f43ae8e93980 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1575 microversion: 2.1 time: 0.156880 May 11 07:53:55.276919 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 482/966] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:55 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:56.294651 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-e3f77556-51d9-498b-9c8c-8fd6924e2d45 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:56.295356 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-e3f77556-51d9-498b-9c8c-8fd6924e2d45 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:56.302382 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e3f77556-51d9-498b-9c8c-8fd6924e2d45 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:56.302835 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e3f77556-51d9-498b-9c8c-8fd6924e2d45 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:56.303602 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e3f77556-51d9-498b-9c8c-8fd6924e2d45 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:56.304040 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-e3f77556-51d9-498b-9c8c-8fd6924e2d45 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:56.434206 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-e3f77556-51d9-498b-9c8c-8fd6924e2d45 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:56.442194 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-e3f77556-51d9-498b-9c8c-8fd6924e2d45 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1575 microversion: 2.1 time: 0.151853 May 11 07:53:56.442754 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 485/967] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:56 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:53:57.458530 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7e4fb7b5-61fe-4076-8772-f638dbb296a5 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:53:57.459136 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-7e4fb7b5-61fe-4076-8772-f638dbb296a5 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:53:57.466188 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7e4fb7b5-61fe-4076-8772-f638dbb296a5 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:57.466634 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7e4fb7b5-61fe-4076-8772-f638dbb296a5 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:57.467559 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7e4fb7b5-61fe-4076-8772-f638dbb296a5 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:53:57.467993 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7e4fb7b5-61fe-4076-8772-f638dbb296a5 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:53:57.600926 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-7e4fb7b5-61fe-4076-8772-f638dbb296a5 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:53:57.608689 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-7e4fb7b5-61fe-4076-8772-f638dbb296a5 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1562 microversion: 2.1 time: 0.154008 May 11 07:53:57.609238 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 483/968] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:53:57 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:55:07.841397 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 07:55:07.841999 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Wed May 11 07:55:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 07:55:12.717814 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 07:55:12.718376 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Wed May 11 07:55:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 07:55:14.344498 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-80e462ea-f201-40a6-acd5-badd02e748fc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:55:14.345023 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-80e462ea-f201-40a6-acd5-badd02e748fc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:55:14.351779 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-80e462ea-f201-40a6-acd5-badd02e748fc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:55:14.352242 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-80e462ea-f201-40a6-acd5-badd02e748fc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:55:14.353136 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-80e462ea-f201-40a6-acd5-badd02e748fc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:55:14.353593 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-80e462ea-f201-40a6-acd5-badd02e748fc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:55:14.380185 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-80e462ea-f201-40a6-acd5-badd02e748fc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Going to try to terminate instance {{(pid=123600) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 07:55:14.406757 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-015a454b-d91f-4ff5-9cd1-791f6de6b003 req-7d663bad-17fe-490b-b99c-cfbf0bc45b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a0a427-0bcd-456c-820d-3b18a16e2ffb", "tag": "ec69841a-e2d2-48f2-87f6-b5b4e8c4bb40"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:55:14.415348 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-015a454b-d91f-4ff5-9cd1-791f6de6b003 req-7d663bad-17fe-490b-b99c-cfbf0bc45b40 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:55:14.415831 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-015a454b-d91f-4ff5-9cd1-791f6de6b003 req-7d663bad-17fe-490b-b99c-cfbf0bc45b40 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:55:14.428517 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-015a454b-d91f-4ff5-9cd1-791f6de6b003 req-7d663bad-17fe-490b-b99c-cfbf0bc45b40 service nova] Creating event network-changed:ec69841a-e2d2-48f2-87f6-b5b4e8c4bb40 for instance 04a0a427-0bcd-456c-820d-3b18a16e2ffb on hv-cinder-83699 May 11 07:55:14.434204 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-015a454b-d91f-4ff5-9cd1-791f6de6b003 req-7d663bad-17fe-490b-b99c-cfbf0bc45b40 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092291 May 11 07:55:14.435163 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 484/969] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 07:55:14.469467 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-80e462ea-f201-40a6-acd5-badd02e748fc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "DELETE /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 204 len: 0 microversion: 2.1 time: 0.129457 May 11 07:55:14.470361 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 486/970] 10.222.0.36 () {58 vars in 1238 bytes} [Wed May 11 07:55:14 2022] DELETE /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 07:55:14.483336 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-7d2969a5-6b59-4739-bcbc-c664832b8be6 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:55:14.483336 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-7d2969a5-6b59-4739-bcbc-c664832b8be6 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:55:14.487622 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7d2969a5-6b59-4739-bcbc-c664832b8be6 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:55:14.487622 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7d2969a5-6b59-4739-bcbc-c664832b8be6 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:55:14.488453 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7d2969a5-6b59-4739-bcbc-c664832b8be6 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:55:14.488889 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-7d2969a5-6b59-4739-bcbc-c664832b8be6 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:55:14.619775 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.policy [None req-7d2969a5-6b59-4739-bcbc-c664832b8be6 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123599) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:55:14.627206 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-7d2969a5-6b59-4739-bcbc-c664832b8be6 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1568 microversion: 2.1 time: 0.152050 May 11 07:55:14.627766 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 485/971] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:55:14 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:55:15.645505 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-a44a5b7f-5f98-4b4d-be6b-cb86de49dbbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:55:15.646219 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-a44a5b7f-5f98-4b4d-be6b-cb86de49dbbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:55:15.653115 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a44a5b7f-5f98-4b4d-be6b-cb86de49dbbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:55:15.653625 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a44a5b7f-5f98-4b4d-be6b-cb86de49dbbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:55:15.654450 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a44a5b7f-5f98-4b4d-be6b-cb86de49dbbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:55:15.654885 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-a44a5b7f-5f98-4b4d-be6b-cb86de49dbbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:55:15.791635 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-a44a5b7f-5f98-4b4d-be6b-cb86de49dbbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:55:15.799454 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-a44a5b7f-5f98-4b4d-be6b-cb86de49dbbc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1568 microversion: 2.1 time: 0.158164 May 11 07:55:15.800055 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 487/972] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:55:15 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:55:16.734696 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [req-443339c1-a6ce-488c-bb93-1a3784a95f7f req-85ebaedc-7158-47e8-9971-940d4e4e5ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a0a427-0bcd-456c-820d-3b18a16e2ffb", "name": "network-vif-deleted", "tag": "ec69841a-e2d2-48f2-87f6-b5b4e8c4bb40"}]} {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 07:55:16.744450 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-443339c1-a6ce-488c-bb93-1a3784a95f7f req-85ebaedc-7158-47e8-9971-940d4e4e5ba8 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:55:16.744888 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [req-443339c1-a6ce-488c-bb93-1a3784a95f7f req-85ebaedc-7158-47e8-9971-940d4e4e5ba8 service nova] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:55:16.756559 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.compute.server_external_events [req-443339c1-a6ce-488c-bb93-1a3784a95f7f req-85ebaedc-7158-47e8-9971-940d4e4e5ba8 service nova] Creating event network-vif-deleted:ec69841a-e2d2-48f2-87f6-b5b4e8c4bb40 for instance 04a0a427-0bcd-456c-820d-3b18a16e2ffb on hv-cinder-83699 May 11 07:55:16.764781 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [req-443339c1-a6ce-488c-bb93-1a3784a95f7f req-85ebaedc-7158-47e8-9971-940d4e4e5ba8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033705 May 11 07:55:16.765579 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 486/973] 10.222.0.36 () {64 vars in 1317 bytes} [Wed May 11 07:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 07:55:16.816100 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-7820d766-8858-47e5-8c8f-18d3b0b81e4a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:55:16.816836 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.compute.api [None req-7820d766-8858-47e5-8c8f-18d3b0b81e4a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123600) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:55:16.823930 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7820d766-8858-47e5-8c8f-18d3b0b81e4a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:55:16.824380 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7820d766-8858-47e5-8c8f-18d3b0b81e4a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:55:16.825147 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7820d766-8858-47e5-8c8f-18d3b0b81e4a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:55:16.825615 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG oslo_concurrency.lockutils [None req-7820d766-8858-47e5-8c8f-18d3b0b81e4a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:55:16.888336 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.policy [None req-7820d766-8858-47e5-8c8f-18d3b0b81e4a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4b533b8bbe4cbabf2780c82f04e44d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919cd09d224147718daec2e2203980f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123600) authorize /opt/stack/nova/nova/policy.py:199}} May 11 07:55:16.895603 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-7820d766-8858-47e5-8c8f-18d3b0b81e4a tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 200 len: 1219 microversion: 2.1 time: 0.083416 May 11 07:55:16.896149 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 488/974] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:55:16 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 07:55:17.914360 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3947ff2e-c923-47f3-93d8-e7590da5abfc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '>' {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:55:17.915057 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.compute.api [None req-3947ff2e-c923-47f3-93d8-e7590da5abfc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] [instance: 04a0a427-0bcd-456c-820d-3b18a16e2ffb] Fetching instance by UUID {{(pid=123599) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 07:55:17.921115 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3947ff2e-c923-47f3-93d8-e7590da5abfc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:55:17.921594 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3947ff2e-c923-47f3-93d8-e7590da5abfc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:55:17.922366 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3947ff2e-c923-47f3-93d8-e7590da5abfc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 07:55:17.922806 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG oslo_concurrency.lockutils [None req-3947ff2e-c923-47f3-93d8-e7590da5abfc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Lock "6c793e13-41c1-4464-88e9-f3c40625395f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123599) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 07:55:17.935615 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.wsgi [None req-3947ff2e-c923-47f3-93d8-e7590da5abfc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] HTTP exception thrown: Instance 04a0a427-0bcd-456c-820d-3b18a16e2ffb could not be found. May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3947ff2e-c923-47f3-93d8-e7590da5abfc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Request method failure captured: May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: request: GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb HTTP/1.1 May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept: application/json May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Accept-Encoding: identity May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Connection: close May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Length: 0 May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Content-Type: application/json May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Host: 10.222.0.36 May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Openstack-System-Scope: None May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: User-Agent: python-urllib3/1.26.9 May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Auth-Token: gAAAAABie2rd3uLzeXMdFhb9CGiHDk0r2gl-DhAaGLiD21Q-ZW6k5jBoKtaVvkUt4hMLvQ8v94YaDtxu7dPdaKkw_8uGroKg9VnfcSG3NdnzDfA9ezcXpKdK_4l87HDl58z4pmTJRnEMnY5Mp7eCp2MNmFQiIFqxMtp5on3UpUcWPibMnJZg4pY May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Id: None May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Domain-Name: None May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Identity-Status: Confirmed May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Is-Admin-Project: True May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Id: default May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Domain-Name: Default May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Id: 919cd09d224147718daec2e2203980f6 May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Project-Name: tempest-TestShelveInstance-1594565889 May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Role: member,reader May 11 07:55:17.937212 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Roles: member,reader May 11 07:55:17.938932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_919cd09d224147718daec2e2203980f6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/919cd09d224147718daec2e2203980f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/919cd09d224147718daec2e2203980f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/919cd09d224147718daec2e2203980f6"}]}] May 11 07:55:17.938932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant: tempest-TestShelveInstance-1594565889 May 11 07:55:17.938932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Id: 919cd09d224147718daec2e2203980f6 May 11 07:55:17.938932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-Tenant-Name: tempest-TestShelveInstance-1594565889 May 11 07:55:17.938932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User: tempest-TestShelveInstance-1594565889-project May 11 07:55:17.938932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Id: default May 11 07:55:17.938932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Domain-Name: Default May 11 07:55:17.938932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Id: cb4b533b8bbe4cbabf2780c82f04e44d May 11 07:55:17.938932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: X-User-Name: tempest-TestShelveInstance-1594565889-project May 11 07:55:17.938932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: method: > May 11 07:55:17.938932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: exception: Instance 04a0a427-0bcd-456c-820d-3b18a16e2ffb could not be found. May 11 07:55:17.938932 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: action_args: {'id': '04a0a427-0bcd-456c-820d-3b18a16e2ffb'} May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: {{(pid=123599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a0a427-0bcd-456c-820d-3b18a16e2ffb could not be found. May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 07:55:17.939902 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a0a427-0bcd-456c-820d-3b18a16e2ffb could not be found. May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a0a427-0bcd-456c-820d-3b18a16e2ffb could not be found. May 11 07:55:17.941479 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: ERROR nova.api.openstack.wsgi May 11 07:55:17.943167 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: DEBUG nova.api.openstack.wsgi [None req-3947ff2e-c923-47f3-93d8-e7590da5abfc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Returning 404 to user: Instance 04a0a427-0bcd-456c-820d-3b18a16e2ffb could not be found. {{(pid=123599) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 07:55:17.943167 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO nova.api.openstack.requestlog [None req-3947ff2e-c923-47f3-93d8-e7590da5abfc tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb" status: 404 len: 111 microversion: 2.1 time: 0.029503 May 11 07:55:17.943167 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: [pid: 123599|app: 0|req: 487/975] 10.222.0.36 () {58 vars in 1235 bytes} [Wed May 11 07:55:17 2022] GET /compute/v2.1/servers/04a0a427-0bcd-456c-820d-3b18a16e2ffb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 07:55:18.089819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: DEBUG nova.api.openstack.wsgi [None req-fd563978-2ce4-4671-aee5-cfe593d46b86 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] Calling method '.version_select at 0x7f19ec9825e0>' {{(pid=123600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 07:55:18.110857 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO nova.api.openstack.requestlog [None req-fd563978-2ce4-4671-aee5-cfe593d46b86 tempest-TestShelveInstance-1594565889 tempest-TestShelveInstance-1594565889-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-970951253" status: 202 len: 0 microversion: 2.1 time: 0.025338 May 11 07:55:18.111433 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: [pid: 123600|app: 0|req: 489/976] 10.222.0.36 () {58 vars in 1250 bytes} [Wed May 11 07:55:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-970951253 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 07:56:59.404802 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 07:56:59.405412 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Wed May 11 07:56:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 07:58:27.849847 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 07:58:27.850342 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Wed May 11 07:58:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 07:58:32.726111 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 07:58:32.726614 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Wed May 11 07:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 08:00:19.413117 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 08:00:19.413870 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Wed May 11 08:00:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 08:00:24.863655 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 08:00:24.864180 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Wed May 11 08:00:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 08:00:30.165625 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 08:00:30.166134 dv-cinder-836996-20-iscsi devstack@n-api.service[123599]: Wed May 11 08:00:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 08:00:30.189339 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 08:00:30.189819 dv-cinder-836996-20-iscsi devstack@n-api.service[123600]: Wed May 11 08:00:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!